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(Arer the past 10 years, interest in the international standing of 
American students has grown rapidly. Although the recent history of 
this interest dates back to the 1950s at the time of Sputnik, the publi- 
cation of A Nation at Risk* in 1983 once again forced us to face the real- 
ity that American students appeared not to be as academically profi- 
cient as their peers in other industrialized nations. It was particularly 
disturbing to note the generally poor showing of the United States rel- 
ative to nations that compete with us in world markets. We began to 
ask again whether our education system was up to the task of preparing 
American youth for the challenges of an increasingly complex, infor- 
mation-based society, and whether our competitive advantage in the 
world economy would be maintained into the 21st century. 

These concerns generated a call to discover those aspects of our 
education system that might be changed to improve student perfor- 
mance. Cross-national studies are helpful in this respect. In addition to 
measuring student achievement and ranking nations in these terms, 
international studies also collect information on the education system 
of each participating country. This kind of information can be particu- 
larly useful since it allows educators everywhere to learn from the expe- 
riences of other nations. 

In 1989 the United States joined the lEA International Reading 
Literacy Study.* Findings from this 3 2 -nation study are available in sev- 
eral lEA publications.^ They show that, contrary to expectation, U.S. 
students turned in a creditable performance vis-a-vis their peers in 
other nations. 

This preface introduces a study of the reading comprehension of 
4th and 9th grade students in the United States that goes beyond sim- 
ple comparisons of national achievement levels. It is based on the data 
generated by our participation in the lEA international project. We 
came away from that project with a rich body of information about our 
own schools and students, and we have taken the opportunity to use it 
to develop a detailed national report for the United States. 
International comparisons are part of this report. They arc presented so 
that the reader can place the United States in an international per- 
spective, compare the performance of various sectors of the U.S. popu- 



‘ lEA-the intemotiona! Association for the Evaluation of Educotiona! Achievement-hos been coordinating cross-notional stud- 
ies in a vonety of subject matter areas since the late 1960s. 



lation with the performance of children in other nations> and, thus, 
evaluate our students against a world standard. We examine the nature 
of the reading skills measured in the lEA study relative to those mea- 
sured in the National Assessment of Educational Progress (NAEP). The 
report also looks at the reading comprehension skills of 4th graders, the 
variation in these skills across various suhpopulations of students, and 
the explanations for these variations according to what families, teach- 
ers, and schools do and provide. 

TTie analyses undertaken are somewhat technical and arc reported 
in detail in a companion report. Reading Literacy in the United States: 
Technical Report. In this volume, however, the authors take pains to dis- 
till the findings and present them in a form that will he familiar to most 
readers. In so doing, they provide us with some valuable insights intc) 
the reading literacy of 4th and 9th graders across the natitm. 



Jeanne E. Griffith 
Acting Commissioner. 

National Center for Education Statistics 
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(executive Summary 



1991, the lEA Reading Literacy Study as^^essed the reading literal 
cy of 4th and 9th graders in many countries. This report presents three 
sets of findings from that report: 

■ how U.S. students compare to students in other anmlries; 

■ relationships between reading comprehension and aspects 
of family, schooling, and community; and 

■ the nature of reading instruction in American classrooms. 

How does the reading performance of American 
students compare to that of students in other 
countries? 

The lEA study painted an encouraging picture ot the reading liteiacy of 
American students, as shown in the first section of the report. American 
4th graders outperformed students from all other nations except Finland 
and Sweden. American 9th graders’ performance was closely grouped 
with that of students from 1 5 other nations. American students outper" 
formed students from 14 countries, while students from Finland outper^ 
formed Americans. 

To create a meaningful benchmark that would provide comparisons 
to many of our trading partners and cc)mpetitors, we constructed a 
“world average” of the 18 participating countries that are also members 
of the Organization for Economic Cooperation and Development 
(C')ECD). Judged against this world average, American students perform 
well overall. Among the 4th graders, the reading performance tif alxHit 
60 percent of U.S. students meets or exceeds the OECD average in the 
narrative and expository domains, as it does for 70 percent of U.S. stu- 
dents for documents. The comparative advantage of American students 
is not as great at 9th grade, where 52 to 55 percent tit U.S. students 
meet or exceed the OECD a\ erage. 



How does the reading performance of subpopula- 
tions of U.S. students compare to that of students in 
other countries? 

The reading performance ot LJ.S. students is related to student charac- 
teristics such as I ace/ethnicity, parental education, and family structure. 
At both 4th and 9th grade, white students, on average, read better than 
black and Hispanic students, and students with at least tine parent hav- 
ing a cc'^llege degree read better, tin average, than students who.se par- 
ents have not finished high school. Students whose families are poor do 
not read as well as th<ise students whtise families are better tiff. 

Most groups t'f American students outperform the C'^FCd') a\’eragc. 
Fven the most tlisatl\’antaged American students dti not tliffer dramati- 
cally from the C')ECD tivertige. The reading perttirmance t)l white stu 
dents, those with at least one parent who attended college, aiui those 
with higher levels of family we<ilth exceed the OEC’D average at both 
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4th and 9th grade. In general, the average performance of Hispanic stu- 
dents does not differ from the OECD average, while the average perfor- 
mance of black students is below the OECD average. Those whose par- 
ents did not finish high school read at about the same level as the 
OECD average at 4th grade, but fall below the OECD average in the 
9th grade. The poorest quartile of students (in terms of an indirect mea- 
sure of family wealth) performs at about the OECD average in both 
grades. Four types of family structure were examined in the report — two 
biological parents, two-parent blended families, mother-only families, 
and ‘‘other” families — and students from each of these types of families 
meet or exceed the OECD average in both grades. Thus, only the per- 
formance of black students in both grades and those in 9th grade whose 
parents did not complete high school did nor consistently meet or 
exceed the OECD average. 

Among white students, about 70 percent of 4th graders and 60 per- 
cent of 9th graders equal or exceed the OECD average. The comparable 
figures for black students are less than 40 percent among 4th graders and 
less than 30 percent among 9th graders, and for Hispanic students, 44 to 
53 percent among 4th graders and about 35 percent for 9th graders. 
Among both 4th and 9th graders, two-thirds of students with college- 
educated mothers exceed the OECD average. In addition, 4th graders 
whose mothers are high school dropouts, on average, do as well as the 
OECD average. But fewer 9th graders whose mothers are high school 
dropouts do as well — only about 35 percent equal or exceed the OECD 
average. Essentially the same observations apply to fathers’ education. 



How do the results from the lEA Reading Literacy 
Study compare with results from the U.S.'s own 
National Assessment of Educational Progress 
(NAEP)? 

Although the overall credible performance of American students on the 
lEA Reading Literacy Test may seem inconsistent with the findings of 
NAEP, which found that only a small percentage of American students 
were able to read at an “advanced” level, this apparent inconsistency 
may be due to differences in the points of comparison used to report 
findings-lEA reporting is based on comparisons of student performance 
across countries while much of NAEP reporting is based on comparisons 
of student performance against a desired standard that has been defined 
independently of rest results. 

A close examination of the two tests reveals marked differences in 
definitiims of reading literacy and in what students must do to demon- 
strate their comprehensi<m of material. The lEA test mainly asks stu- 
dents to recognize details and to make simple inferences and literal 
interpretations. The N \EP test requires students to do all these things, 
but in addition, it asks them to identify themes, detect the author’s 
point of view, make larger inferences, express opinions and support 
them with citations from the text, and write summaries of the reading 
selections on the test. 
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How do the characteristics of families and schools 
relate to the reading performance of American 
students when other factors are taken into account? 

Factt^rs Mich as parental education, tamily wealth, race/cthnicity, and 
family structure tend to be related to taie another. For example, the par- 
ents in poor (ami lies are more likely to be high school dropouts. The 
second sectitm of the rept>rt is ba>ed tui statistical analyses that tease out 
the unique nature of relationships between the characteristics of 4th 
grade students, their families, their schools, teachers, and communities, 
and narrative comprehension levels, and that allow an interpretation iT 
the effect of individual factors ot/ier things eqml. 

The results of those analyses suggest that when differences in 
wealth, race/ethnicity, level of parental education, and tuher related 
attributes are taken into account, children from one-parent mother- 
only families appear to do as well as children from two-parent families 
in which both parents are the student’s biological parents, and both do 
better than children from two- parent blended families, where one t^r 
both of the parents is a stepparent or guardian. 

Although coming from a poor family is strongly associated with 
pO(.ir reading achievement, when parents’ education, minority status, 
and the like are factored out, the apparent reading achievement gap 
between the rich and poor is reduced by two-thirds. The educational 
attainments of both mothers and fathers influence reading comprehen- 
sion over and above other aspects of family background. 

In elementary schools with high levels of parental invtdvement, 
children do better in reading compreliension; other things equal, 4th 
grade average reading scores arc 26 points below the national average 
where involvement is low but 17 points above the natimial average 
where parent im olvement is high. 



what does reading instruction look like in 
the United States? 

The third section of the repi^rt examines the beliefs and practices of 
American teachers with regard to the te.iching of reading. Teachers’ 
responses to (.luestions related t(^ instructional practices suggest that 
wh.u teachers say they belie\e about reading instruction dilfers marked- 
ly \ro\w what thev actu.dly do and have students do. 








for this report, was conducted under the auspices ot the International 
Association for ihe Evaluatu^n ot Educational Achievement (lEA). The 
International Steerin^^ Committee, the Interiiational CJoordinatinu 
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was U-S. National Research Coordinator, and project directt>r tor the 
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described in that report. Thus, those individuals acknowledj^ed in that 
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Westat. who undertot^k many ot the analyses conducted especially tor 
this repeat, as well as those in the technical report . 
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panel provided many important su^^estiims tor improv’ement, and the 
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they arose. Responsibility for any remaining errors rests with the 
authors. 
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Introduction 



Since colonial rimes, Americans have seen literacy as an essen- 
tial requirement for citizens in a democracy. In the 20th century, 
the American people have shown a continuing concern for 
improving the literacy levels both of students in school and of 
adults. The U.S. government regularly measures the reading skills 
of our school-age population and takes a similar, themgh less fre- 
quent, interest in the ■ .teracy levels of adult Americans. 

The results of these studies are not always encouraging. The 
Natiimal Assessment of Educational Progress (NAEP) has 
tracked the reading performance of students periiodically since 
1969. Its 1992 natUonal report aoncludes that while most students 
at grades 4, 8, and 12 have mastered basic aompetencies, too few 
have reached levels likely to he required tor the 2 1st century 
work place.' The results of the National Adult Literacy Study 
(NALS) are no imore encouraging. Large percentages of adults 
demonstrate limited skills that may restrict their opportunities 
tior gaining access to and achieving in many i occupations.*^ 

The intormatiion trioin the lEA International Reading 
Literacy Study, however, seems to contradict NAEPs finding 
aUout the reading abilities o\ American students. On all three 
dimensiions of reading literacy included in the study (narrative, 
expiository, and diocuments), American students are either second 
among the nations or their scores are not significantly different 
Irom the saws of students from other adx’anced nations. 
(Analyses reporting international comparisiMis are available in 
several publicatiions.'^) 



Organization of This Report 

Althinigh we begin with international coniparisims, the primary 
hocus oi Reading Literacy in r/ie United Stares: Fuuiings Fro?n the 
IE A Readni.q Litaacx Sfud\ is on the re<\ding comprehension of 
4th and 9th grade American stiulents. The report folKows three 
separate lines of inquiry. In the first, we aompare the performance 
lof American students on the lEA Reading Literacy Test tio that 
I of students m i other natiions. Because lour students did better than 
might have been expected given U.S. perhormance ion tother 
internaticonal aomparative assessments and repiorts fnom the U.S.- 
only Naticonal Assessment of Edueatiion Progress, we Kotoketl at 
dillerences between the test instruments in order to explain the 
appanuTt discrepancy. In addition to looking at ctomparisions 
across naliions, the aomparisions were extended to determine 
whether .ill seuors of lour student piopulatiion denu»nstrate the 



same hi^h levels of literacy. Our second line of inquiry tocuses on 
the relationships between reading comprehension and aspects ot 
family* schooling, and community. Usin^ ct)mplex statistical pro^ 
cedures, we more finely examine the complex relationship amon.^ 
the variables that may have an impact on the de\*elopment ot 
reading coinprehenskm skilb. Finally, in the third section* we 
examine the nature ot reading instruction in American class^ 
rooms so that we might present a quick snapshot ot the current 
state of the art in instruction. In this manner, we create three sep' 
arate complementary pictures of reading comprehension and 
instruction in the United States. 



International Comparisons 

Charts that rank nations according to the achiex’cment levels ot 
their students capture much public attention, probably because 
they touch on matters ot national pride and arouse concerns 
about the nation’s reserves ot human capital. The International 
Association tor the Evaluatitm ot Educational Achievement has 
been the primary source t'jf such comparisons oxer the past 30 
years. In most, the United States has lagged behind other 
nations, especially in mathematics and science. 

Dimensions of the lEA Reading Literacy Study 

In 1989, popular interest in the reading skills ot American stu- 
dents, and the question ot where xve stood relatix*e to tether 
nations xvith regard to reading literacy, led the United States gov- 
eminent to join 31 other nations in an international study ot 
reading literacy spemsnred by IE A. Exhibit 1 lists the partici- 
pating nations.'^ 

Assessing Reculftig Literacy. To ensure fairness in international 
compari''ons, lEA studies begin with a search tor curricular ele- 
ments common to the pariiupating nations. Achievement tests 
are then developed based on these ccnnnuni elements. This 
process is designed to ensure that each nation s students hax*e an 
equal chance to demonstrate their skill. 

Within this context, lEA defined reading literacy in the 
folloxving xvay: 

. the dhiln>> iouL'rs(<nhl iiiul use thnsr uritteu /an.OM.i^c /onns 
U'(|i(avi/ h\ sneiety iuul/(*r uilued hs (he hUnuludi^' 

‘Although 32 (ountnes portKipoted in the study ns o whole, only 30 countnes (olloded doio leloted to 9*year-old$ (4th 
Qfode ii? the United States) ond only 2/ piovided usoble doto Siiriiloily, 32 notions (olloded dole leloled to 14 yeo(-olds 
(9th giade m the United Stetes*. but only 31 notions enteied the onolyses 
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Portkipotiog Countries 



Belgium (French) 


Netherlands 


Botswana 


New Zealand 


Canada (British Columbia] 


Nigeria 


Cyprus 


Norway 


Denmark 


Philippines 


Finland 


Portugal 


France 


Singapore ' 


Germany (East) 


Slovenia 


Germany (West) 


Spain 


Greece 


Sweden 


Hong Kong 


Switzerland 


Hungary 


Thailand 


Iceland 


Trinidad & Tobago 


Indonesia 


United States 


Ireland 


Venezuela 


Italy 


Zimbabwe 



O 



17 





Countries Ranked by 4th Grade Reading 
Achievement: Total Score 

Stoedard 



Country 



Moon Error 







.-2.8' 


Swiilin . . 


.S39 


21 


France 


,. 531 


4.0 


Italy 


.. 529 


4.3 


New Zealand 


,. 528 


3.3 


Norway 


.. 524 


2.6 


Iceland* 


.. 518 


0.0 


Hong Kong 


.. 517 


3.9 


Singapore 


.. 515 


1.0 


Switzerland 


.. 511 


2.7 


Ireland 


.. 509 


3.6 


Belgium (French) 


.. 507 


3.2 


Greece 


.. 504 


3.7 


Spain 


.. 504 


2.5 


Germany (West) 


.. 503 


3.0 


Canada (British Columbia) 


.. 500 


3.0 


Germany (East) 


.. 499 


4.3 


Hungary 


.. 499 


3.1 


Slovenia 


.. 498 


2.6 


Netherlands 


.. 485 


3.6 


Cyprus 


.. 481 


2.3 


Portugal 


.. 478 


3.6 


Denmark 


.. 475 


3.5 


TrinidadAobogo 


.. 451 


3.4 


Indonesia 


.. 394 


3.0 


Venezuela 


.. 383 


3.4 


^Icelond tested oil students, therefore no standard error wos calculated. 



The designers applied this detinirion of literacy to the three 
text forms that students most often encounter in school and in 
everyday life: 

■ narrative prose — text in which the writer tells a story, 
whether fact or fiction; 

■ ex[)ository prose — text in which the writer describes, 
explains, or otherwise conveys factual information or 
opinion; and 

■ documents — information displays such as charts, maps, 
tables, graphs, lists, or sets of instructions. 

lEA developed tests for each of the three forms of literacy. 
Students responded to most questions in a traditional multiple^ 
choice format, although they had to write brief answers to a few 
questkms.* 

Questionnaires. The students, akmg with their teachers and the 
principals of their schools, also completed questionnaires that 
sought information on the attributes of families and schools relat- 
ed to these essential skills.** 

Student Populations Sampled. In each of the 32 participating 
nations, national samples of classes at the grade level containing 
the most 9-year-olds and 14-year-olds were selected to take part 
in the study. The selected classes included students who were all 
full-time, mainstreamed members of regular classes. The United 
States tested students in grades 4 and 9 because these grades gen- 
erally contain 9-year-olds and 14-year-c4ds. At the 4th grade, we 
sampled regular classes; at the 9th grade, we sampled EngUsh/lan- 
guage arts classes. 



BH Meon achievement higher than United States 
Mean achievement equal to United States 
Mean achievement lower than United Stotes 

SOURCE: Elley, Warwick B., How in the Woild Do Students Ihe Hague. 
International Association for the Evaluation of Educational Achievement, 1 992. 



Comparisons with All lEA Participating Countries 

Tables 1 and 2, adapted from the lEA internaticmal report Hcnv 
in t/ie World do Students Read!^^ shcm* the national averages for 
9-ycar-olds and 14-year-olds, respectively. In each table, countries 
arc ranked in descending order on a measure o{ overall reading 
comprehension — one that combines the scores on narrative, 
expository, and dcKiimcnts ccMuprehension. 

*Eof a full description of the test instrument, see Chapter 7 of Mmg btaocy m the United Stotes. leclmal f^epoit. 

* ‘for a full desenption of the questionnaires used to collect these data, see Chapter 1 1 of Reading Litetacy in the United 
Stotes. Fechnicol Report. 
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The messii^e o( these tables seems straightforward at first 
: 4 lance: U.S. 4th graders place seccMid after Finland, and our 9th 
graders place ninth after Finland, France, Sweden, New Zealand, 
Hunj^ary, Iceland, Switzerland, and Hon^ The picture, 

however, is not as clear cut as it mi^ht appear. Natii^nal means 
are based on samples of students, ncH whole student populations,* 
and thus have a decree of samplinj^ variation associated with 
them. When w'e consider the effect of such samplinj^ variation (as 
measured by the standard ern^r) on national averages, as well as 
the very small differences between countries, the ranked differ- 
ences could be due to such variability rather than to real differ- 
ences in the achievement i^f natiiMial populatiiM'is. 

Within this context, Finland’s 9-year-olds continue to out- 
perform 9-year-olds in the United States, and Sweden’s national 
average is not reliably different from that of the United States. 
However, the United States does have a natioital average reliably 
greater than the remaining countries. 

In the case of K-year-olds, Finland’s mean score is reliably 
greater than that of the United States. But the performance lev- 
els of 15 of the 30 remaining countries are not reliably different 
from that of the United States. The 15 are France, Sweden, New 
Zealand, Hungary, Iceland, Switzerland, Hong Kong, Singapore, 
Slovenia, East Germany, Denmark, Portugal, C^anada (British 
Columbia), West Germany, and the Netherlands. This leaves 
U.S. students outperforming those in the remaining 14 countries: 
Norway, Italy, Ireland, Greece, Cyprus, Spain, Belgium (French). 
Trinidad and Tobago, Thailand, Philippines, Venezuela, Nigeria, 
Zimbabwe, and Botswana. 

Since Tables 1 and 2 repc^rt the ccMnbined scores cm narra- 
tive, expc'jsitory, and dcKuments reading comprehensiem, they 
may obscure the naticMial differences that cKcur fc'>r each dennain. 
Reading experts believe that the three domains require some- 
what different types of reading and thinking. They alsc^ assume 
that national educational systems and cultures may differ in their 
relative emphasis on each type c4 reading task. 






Countries Ranked by 9th Grade Reading 

Achievement Total Score . , . 

Stomiord 

Country Mum Error 




Norway 


...516 


2.3 


Italy 


...515 


3.4 


%firifiarfanifr ' 


■L';SiVV 




Ireland 


511 


“S.2 


Greece 


... 509 


2.9 


Cyprus 


... 497 


2.2 


Spain 


... 490 


2.5 


Belgium (French) 


... 481 


4.9 


TrinidndAobago 


... 479 


1.7 


Thailand* 


... 477 


6.2 


Philippines 


... 430 


3.9 


Venezuelo 


... 417 


3.1 


Nigeria* 


...401 


— t 


Zimbabwe* 


... 372 


3.8 


Botswana 


... 330 


2.0 



*Sompling response rote of schools below 80% 
t Insufficient data to cokukite standord efror 



‘Iceland (S an exception, the whole 4th rifode populotion was icsied 



IHII Mean ochievement highei then United States 
Mean achieveinent equal to United States 
Mean achievement lower than United States 
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SOURCE' Elley. Warwick B . How in the WofM Do Students Peod^, Ihe Hogue' 
intcmotionol Assonotion lor tl.e Evoluoiion of Educotionol Achievement, 1992 




To make these differences clear, we reproduce six figures from 
H(m’ in the World do Students Read’ to show how national rankings 
differ across the three reading domains. Figures 1/2, and 3 



Figure 1 



Countries Ranked by 4th Grade Reading Achievement: Narrative Score 

100 200 300 400 500 600 700 800 



Finland 
United States 
Sweden 
New Zealand 
Italy 
France 
Norway 
Singapore 
Iceland 
Ireland 
Greece 
Belgium (French) 
Switzerland 
Slovenia 
Canada (BritKh Columbia) 
Spain 
Hungary 
Hong Kong 
Netherlands 
Cyprus 
Germany (Wesil 
Portugal 
Germany (Fast) 
Denmark 
TrinidadAobago 
Indonesia 
Venezuela 




5lh 



Percentiles of performance 
25lh confidence Interval 75lh 




95lh 



tiOlE the (entei solid box ind'catis o a*nlideiue ntcivol nround the oveiuge reoding piolinenty lot o (ountiy; 5th, 25th, 75th, ond 9Sth peiccntiles ore indicoted by slioded bois 
SOURCE. Elley, V/orwi(k B , Wow (.t the World Do Students The Hogue InlemotionnI Assotiotion lor the Ivoluotion oi Educolionol Achievement, 1992. 
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rank the reading performance of 9-vear'olds for the three dcmiains 
respectively. Figures 4,5/ and 6 rank the performance of 14' 
year-olds for the same three domains. 



Figure 2 



Countries Ranked by 4th Grade Reading Achievement: Expository Score 



100 200 300 400 500 600 700 800 



Finland 
Sweden 
United States 
Italy 
France 
New Zealand 
Norway 
Singapore 
Iceland 
Ireland 
Greece 
Switzerland 
Spain 
Belgium (Fremh) 
Hong Kong 
Canada (British Columbio) 
Germany (West) 
Hungary 
Germany (Eost) 
Slovenia 
Netherlands 
Portugal 
Cyprus 
Denmark 
TrinidadAobago 
Indonesia 
Venezuela 




Percentiles of performonce 

5th 25th confidence intervol 75th 95lh 



NOIE Ihc (enter solid box inditotcs o (orjidente mteivol oround the ovefcgc icoding ptofinenty for o country, 5th, 25th, 75th, ond 95th pc((cnttlcs nre tndKofed by shaded bors 
SOURCE Etley, Warwick B , How m tfie Wofid Do Student ^ead^ The Hague: Inteinatianal Assaciotian far the Evaluation af Educatianol Achievement, 1992 
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Countries Ranked by 4th Grade Reading Achievement: Documents Score 



Finland 
Hong Kong 
United States 
Sweden 
France 
Switzerland 
Germany (Eos!) 
New Zealand 
Germany (West) 
Norway 

Iceland 

Italy 

Hungary 
Spain 
Belgium (Fremh) 
Singapore 
Slovenia 

Canada (British Columbia) 
Denmark 
Ireland 
Greece 
Netherlands 
Cyprus 
Portugal 
TrinidadAobago 
Venezuela 
Indonesia 




5th 



Percentiles of performance 
25 th confidence intervol 25th 




95th 



NOTE' The center solid box indicates o confidence iniervol oiound the average reading proficiency for a country; 5th, 25th, 75th, ond 95fh percentiles are indicoted by shoded bars. 
SOURCE: Elley, Vtoick B„ Woa'/o the World Do Studcf)ts Reod^ The Hague. International Association for the Evoluation of Educational Achievement, 1992. 














Figure 4 



Countries Ranked by 9th Grade Reading Achievement: Narrative Score 



Finland 
France 
Sweden 
Iceland 
New Zealand 
United States 
Slovenia 
Switierland 
Singapore 
Hungory 

Canada (SrHisli Columbia) 
Greece 
Partugal 
Italy 
Denmark 
Cyprus 
Norway 

Germany (w«t) 
Germany (East) 
Ireland 
Hong Kong 
Netherlands 
Spain 
Belgium (French) 
TrinidadAobago 
Thailand 
Philippines 
Venezuela 
Nigeria 
Zimbabwe 
Botswana 




Percentiles of performonce 

5th 25th confidence intervol ^5th 



95th 



NOTE. The center solid box mdicotes o confidence interval oround the overage reoding proficiency for a country; Sth, 25th, 75th, ond 95th percentiles are indicated by shaded bars 
SOURCE Elley. Warwick B How m the World Oo Sivdent^ Read^ The Hogue; Internotionol Associotion foi the Evoluotion of Educotional Achievement, 1992. 



o 

ERIC 






9 




Figure 5 



Countries Ranked by 9th Grade Reading Achievement: Expository Score 



100 200 300 400 500 600 700 800 



Iceland 
France 
Finland 
Hang Kang 
United States 
Singapare 
Hungary 
New Zealand 
Sweden 
Switzerland 
Slovenia 
Denmark 
Italy 
Portugal 
Germany (Eost) 
Germany (West) 
Narway 
Canada (British (olumbio) 
Greece 
Ireland 
Netherlands 
Spain 
Cyprus 
Thailand 
TrinidadAobago 
Belgium (Fren(h) 
Philippines 
Venezuela 
Nigeria 
Zimbabwe 
Botswana 




5th 



Percentiles of performance 
25th confidence intervol 75th 




95th 



NOU fhe tenter soiid box indicates o (onfidcnce mtcrvol mound the ovetoge tending pioficienty fot a touiiltv. 5ih. 25ili, 75th, ond 95th m itentiles me indicated by shaded bets 
SOURCE [Hey Worw'ck B Wmv >n the World 9o Studenti ^eod? Ihe Hague Intemoticn^ji Association for the Fvaluotion of Educational Achievement, 1992 
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Countries Ranked by 9th Grade Reading Achievement: Documents Score 



Finland 
Hong Kong 
New Zealand 
Sweden 
Switzerland 
France 
Germany (Easi) 
Hungary 
Slovenia 
Singapore 
Netherlands 
Denmark 
Germany (We$t) 
United States 
Portugal 
Canada (British Cotumbio) 
Ireland 
Norway 
Iceland 
Italy 
Greece 
Belgium (french) 
Cyprus 
Thailand 
Spain 
TrinidadAobago 
Philippines 
Venezuela 
Nigeria 
Zimbobwe 
Botswana 




NOIt. The center solid box indicates o confidence intei^ol around the overage reading profinency for o country; 5th. 25th, 75tli, and 95th percentiles oie iiidicoted by shoded bars 
SOURCE. Elley. Warwick B.. How in fhe Woild Do Students The Hogue' Internotionol Associcition for the Evoluotion of Educational Achievement. 1992. 
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Perhaps the most sij^nihcant points to be gleaned troin these 
six hf^ures are that: 

■ U.S. 4th graders comprehend narrative text as well or het- 
ter than students from any other nation except Finland. 

■ Althouj^h 4th graders appear place third on expos- 
itory comprehension, only Finland does better and there is 
very little ditfcreiice in our performance and that of 
Sweden, Italy, France, New Zealand, and Norway. 

■ While students in Finland do better than the U.S. 4th 
graders, c^ur students comprehend dcKuments as well as 
.Students in Hong Kong and Sweden, and they do better 
than the students in the 2.3 other countries included in 
this ranking. 

■ U.S. 9th graders do about as well as students from France, 
Sweden, Iceland, New Zealand, Slovenia, Switzerland, 
Singapore, Hungary, Canada (British Columbia), Greece, 
Portugal, and Italy with respect to narrative comprehen- 
sion, but not as well as those from F-inland. 

■ U.S. 9th graders’ expivsitory comprehension ranks equal to 
that of students in 16 other nations, with 14 countries 
ranking below the United States in this domain. 

■ U.S. 9th graders’ documents comprehension lags behind 
that of 9th graders from five other countries (Finland, 
Hong Kong, New Zealand, Sweden, and Switzerland), but 
it is not different from that of 11 other anintries and 
exceeds that of the remaining 14 auintries. 

We canntn explain how these between-nation differences 
come about, but the overall performance oi U.S. .students is wel- 
ciMne good news in the face of the bad news about the achieve- 
inont of American .students in caber internaticM^al comparisons. 
In reading, at least, American students are among the best of the 
32 nations inv(dved in the study. With the exception of Finland, 
no country ccMisistently outperforms the United States. 

Comparing IE A and NAEP 

In contrast to the good news pnwided by the lEA studv, where 
American 4th and 9th grade students do well when com, a red t(' 
studenn- from other ccnmtries, the picture of American students' 
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reading proticicnoy provitlcd by the NaticMial Assessment of 
Ediicatumal Progress seems less optimistic. For example, in 1992 
NAEP reported that 

. . . For.i^tides 4 . ‘S. and 12, the /vrcvnta,jTcs ofsntdcnts esthnaicd 
t(f have met or exceeded the Proheienr achkncnu'nr level uvre 29, 

29, and 40 f)ercent, reslyeetively. Pn^ticient, the centra/ level, rc/v 
resents solid academic /)e)/onntmce and corn/k»tcnc\ (u cr c/m/len.ij' 
subject matter (for the ^'cule level). 

. . . The Advanced achievement level sii^iifies .sn/vr/or per/or- 
mance beyond Proficient. Very few students at any of the three 
f^\ides assessed attained the Advanced level — /nan 3 to 6 percent.'^ 

By 1994, the NAEP picture was slii^htly worse; the average 
reading proficiency of 12th ^rade students declined significantly 

from 1992 to 1994- 

This contrast of oood news versus potential “doom and 
oloom” made us wonder whether lEA and NAEP report and/or 
measure different thinj^s. This question is addressed in the fed" 
lowing discussie>n. 

Differmg Points of Comparison. One of the first things to cori" 
skier was whether the data are reported in the same manner 
acrerss NAEP and lEA. Although both provide descriptions of 
reading perfi^rmance oi analogous samples oi students, the basis 
for reporting, in fact, differs considerably. 

In the case e)f lEA, reporting is based on comparisems of the 
performance of grtnips tif students within and across countries. 
Student perk^rmance in one country is compared to that of stU" 
dents in the other participating countries. Or, students in one 
subgrtuip within a antntry are compared tt) tither students in 
tether subgroups within the same country. We look at issues such 
as mean performance of eacli country or the tlistribution of scores 
within a country as emnpared it) the distribution of scores in 
other countries. W' are always comparing students against stU" 
dents. As such, the point of comparison is a relative rather than 
an absolute comparisem. 

Alternatively, much of the NAEP reporting is based on cont" 
parisons between actual student performance and desired perform 
mance. It is a compartson against an absolute standard or criteri" 
on that is defiried inLiepeiulently of what students lIo. As 




Jescrilx‘J in the NAEP 1992 Kcadinfi Ke/)ort CmvcI for the Nation 
and the States, “To entry our its responsibilities, NAGB [the 
National Assessment Governinj^ Board] deveK)ped achievement 
lei'eis, which are collective judgments about how students should 
perform relative to a body of content reflected in the NAEP 
frameworks. The result is translated onto ranges alon^ the NAEP 
scale.” As such, the reporting is referenced to a description of the 
tasks that students are expected to be able to do, or that someone 
or some ^roup thinks they shtiuld do. This is a criterit^n' refer' 
enced aanparison. 

Success or failure in either ctmtext dtws ntit necessarily imply 
success or failure in the other context . CtM'isequently, American 
students do very well based on the relative ctanparistms used by 
IE A, but within the NAEP aa'itext they do ntH dt) as well as 
NAGB believes they should be dtnn^. 

Differing Definitions. In addition, NAEP and lEA define read' 
in^ differently. Although their definititms overlap, thert are 
enough differences in emphasis to further explain stime of the 
seeming inconsistencies between NAEPs and lEAs findings. 

Btith lEA and NAEP expect literal aanprehension and the 
development oi understanding. Btuh define parallel domains: 
narrative prose, expository prose, and documents in the case i^f 
IE A; literary experience, to be infoniKxl, and to perftirm a task in 
the case of NAEP. However, there is a major difference between 
lEA and NAEP in what students must do to demonstrate their 
comprehension. While success in lEA depends on reaching and 
correctly answering more questions directly related to the paS' 
saue, to reach NAEPs advanced level, 4th ^rade .students, ftir 
example, 

. . . uvre able to imer/m't tmd t’Xtmiinc f/k* meaning oj text. They 
m/on?ian'»)n (un>s> u/in/t’ it’Vts. deielolK'd their oun 
idt’us a/i*»!a fL'.vma/ m/arnuitiom lau/crstood some literary deiiLCS. 
dUil Ul'tc tn fonnalarc more comjdcx ejU' ^tums about 



Ei^htl^ even turthcr. They 

. . , on)i/>a)Vii timi unurasrai nijornuinon iicros’s ))inlnplt’ te.vfs. 

They ondJ eowwet mfereua's with themes, louler^unul uuilerlyn\i^ 

nu’imm,ijs . and iutep'cite jyrhr kuowlediie with text interlmetutinus. 

They also denumstraied s^me ahility to euihuite the Innitatiims (;/ 

E^.|unlly iinport;mt is the fact that NAEP requires students to 
^ei^orate answers in their mvn words much more frequently than 
lEA, wliicli mainly asks students to respond to the test designers’ 
options. Thus the skills required hy lEA readinj^ tasks can he seen 
as a subset c»t tliose required hy NAEP. 

So that the reader mif^ht better understand the ditterences 
between the test instruments, we have reproduced a passage and 
its associated questiims from both the lEA and NAEP tests. 
Exhibit 2, ijrandjhi, drawn from the lE.A 4th urade test, was sub- 
mitted by the Danes. It is a folk sStory and describes family rela- 
tionships. Exhibit 3, Sybil Soimd.s the Alarm, a story set during 
the American Revolution, was drawn from the NAEP 4th ^rade 
test. While both sets of items are based on complete stories, the 
selection from NAEP is a lon^^er, more well-developed story and 
includes more information that i'' probably less familiar to the 
intended student audience. 

The questions related to the NAEP passa^^e are also more 
diverse in nature. As seen in NAEP questions 3 and 7, students 
mu.st ^o beyond the information in the passage and compare it to 
knowledge they have from other sources, even it it is only their 
own experience, in iirder to answer the question. Reading experts 
would point out that because many of these questions have stu- 
dents recall and construct their answers, the students are more 
likely to be actively entia^ed in what they have read. In contrast, 
only the final ».iuestion associated with Grandpa asks that stu- 
detus construct their own response. However, it is important to 
note that this item was not ituluded in the international scale 
aiKl was only included in select ciuintries (the United States 
amon^ them) for separate special analyses.’"' 



‘A full distuvsion ot thn open-ended IE A items inoy be found m Chcotcf S of /if9//iodo.’or//fo/ /ssues m (on)poioUvo 
fdinntionoi Sfudicx the (ose of tiw IfA Mmg liteuKy Study 
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A Story on the lEA Test for 4th Graders 




Once upon a time, there was a very old ma. His eyes had become weak. His ears were deaf, and his knees would shake. 
When he sot at the table, he was hardly able to hold the spoon. He spilled his soup on the tablecloth, and he often slobbered. 

He lived wHh his son and daugh<er-in-law. They abo had a small boy who wos four years old, so the old man wos a 
grandfather. 

His son and his son's wife found it disgusting to ses him spilling food at the tuble. And so they finally ordered him to sit 
in a corner behind the stove. Here, they served him his food on o small eorthenwore plate. Grandpa didn't even get enough to 
satisfy his hunger. He sat there feeling sad. He looked at the table, when the otbrs were eating, and his eyes filled with tears. 

Then, one day his shoking hands could not even hold the plate. It fell to the floor and was broken into many pieces. The 
young wife scolded him. But the grandfather said nothing. He just sighed. Then the young wife bought him a very cheap wooden 
bowl. How he hcd to ect from that. 

One doy, while they w<*'o t>aving dinner, the grandchild sat on the floor and wos very busy with some small pieces of wood. 

'Vfhat are you doing?" osutul his father. 

"I am making a bowl," the boy answered. 

■matisitforf 

"It is for my father and mother to ect from when I grow up." 

The man end his wife looked at each other for a long time. 

Then they started crying. At once, they asked the old grandpa bock to the table, ond from then on he always ate with 
them. After that, even if he sometimes spilled his food, they never said o word about it. 

1 . What happened when Grandpa sat at the table? 

A. He always hod a good meal. 

B. His feet would shake. 

C. He spilled his soup. 

D. He dropped his plate. 

2. The son and his wife asked Grandpa to sit behind the stove because 

A. it was warmer there. 

B. the table was not big enough for everyone. 

C. he could not see or hear. 

D. they did not like to see him eat. 
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A Story on the lEA Test for 4th Graders (continued) 



3. Why did the son's wife scold Grandpa? 

A. He spilled his soup. 

B. He broke his plate. 

C. He looked so sad. 

D. He showed bad manners. 

4. Grandpa was given a new bowl made of wood because 

A. he wanted such a bowl. 

B. the family had no more earthenware plates. 

C. a wooden bowl does not break so easily. 

D. they boy hod made one for him. 

5. How did Grandpo feel when he sot by the stove? 

A. Bored 

B. Tired 

C. Pleased 

D. Unhappy 

6. The son and his wife cried because 

A. the boy wanted to make o wooden bowl. 

B. their father couli not eat properly. 

C. they understaod that they too would grow old. 

D. the wooden bowl was also broken. 

7. Why did the parents decide to ask Grandpa back to the table? Write your answer on the lines below. Make sure you 
write enough to make your answer clear. You may want to use examples from the story to help explain your answer. 



SOlit!(f U S Oepoilincm ci! Educohon. Notionol Centei tot Edwation Stotiitiis, Ming lilao:/ in the Uniteii States: redmol Hepott Woshington D C • 1 994. 
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Exhibit 3 



A Story on the NAEP Test for 4th Graders 



Sybil Sounds the Alarm 

by Drollene P. Brown 

A red sky at night does not usually cause wonder. But on the 
evening of April 26, 1777, the residents of Ludingtons* Mills were con- 
cerned. Ibe aimson glow was in the east, not from the west where the sun 
was setting. 

The Ludington family sat at supper, each one glancing now and 
again toward the eastern window. Sybil, at sixteen the oldest of eight chil- 
dren, could read the question in her mother's worried eyes. Would Henry 
Ludington have to go away again? As commander of the only colonial 
army regiment between Danbury, Connecticut, and Peekskill, New York, 
Sybil's father did not have much time to be with his family. Thudding 
hooves in the yard abruptly ended their meol. The colonel pushed back his 
chair and strode to the door. Although Sybil followed him with her eyes, 
she dutifully began to help her sister Rebecca clear the table. 

The girls were woshing dishes when their father burst hek into the 
room with o courier at his side. 

**Here, Seth," said the colonel, "sit you down and hove same supper. 
Rebecca, see to our weary friend." 

Sybil, glancing over her shoulder, sow that the stranger was no 
older than she. A familiar flame of indignation burned her cheeks. Being 
a girl kept her from being a soldier! 

Across the room, her parents were talking together in low tones. 

Hfei father's voice rose. 

"Sybil, leave the dishes and come here," he said. 

Obeying quickly, she overheard her father os he again spoke to her 
mother. 

"Abigail, she is a skilled rider, it is Sybil who has trained Star, and 
the horse will obey her like no other." 

Thot red glow in the sky," Colonel Ludington soid, turning now to 
his doughter, "is from Danbury. It's been burned by the British raiders. 
There are ubout two thousand Rodcoats, and they're heading for 
Ridgefield. Someone must tell our men that the lull in the fighting is over; 
they vill hove to leave their fomiiies and crops ogain." 

"ri! go) Star ond ) can do Iti" Sybil exclaimed. She fared her moth- 
er. "Stor is sure of foot, and will carry me safely." 

There are dongers other than slippery poihs," her mother soid, 
softly. "Outlaws or deserters or e^*en British soldiers may be met. You must 
be wory in a way that Star cannot." 

A lump rose in Sybil's throat. 1 con do it," she declared. 

Without another word, Abigail Ludington turned to fetch a woolen 
cape to protect her daughter from the wind and rain. One of the boys was 
sent to saddle Stor, and Sybil was soon ready. When she hod swung up on 
her sturdy horse, the colonel ploced a stick in her bond. 



As though reciting an oath, she repeated her father's directions: "Go 
south by the river, then along Horse Pound Road to Ma^opac Pond. From 
there, turn right to Red Mills, then go North t.) Stormville." The colonel 
stood back and saluted. She wos off! 

At the first isolated houses, windows or doors flew open as she 
approached. She shouted her message and rode on. By the time she 
reached the first hamlet, all was dark. There were many small houses 
there at the edge of Show's Road, but everyone was in bed. Lights had 
not flared up nt the sound of Star's hoofbeots. Sybil had not anticipated 
this. Biting her lower lip, she pulled Star to a halt. After considering for a 
moment, she nudged the horse forward, and riding up to one cottage 
after another, beat on each door vrith her stick. 

"Look at the sky!" she shouted. "Danbe^y's burning! All men muster > 
at Ludington's'i" 

At each village or cluster of houses, she repeated the cry. When 
lights began to shine and people were yelling and moving about, she 
would spur her horse onword. Before she and Star melted into the night, ■ 
the village bells would be pealing out the alarm. 

Paths were slippery with mud and wet stones, and the terrain wos 
often hilly and wooded. Sybil's ears strained for sounds of other riders 
who migh; tiy to stool her horse or stop her mission. Twice she pulled Star 
off the path while unknown riders passed within a few feet. Both times, 
her fright dried her mouth and mode her hands tremble. 

By the Mme the reached Stormviile, Star had stumbled several times, 
and Sybil's voice was almost gone. The town's call to arms wos sounding as 
they turned homeword. Covered with mud, tired beyond belief, Sybil could 
borely stay on Star's bock when they rode into their yard. She hod ridden 
more than thirty miles that night. 

In a daze, she sow the red sky in the eost. It wos down. Severol 
hundred men were milling about. She had roused them in rime, and . 
Ludington's regiment marched out to join the Connecticut militki in routing 
the British at Ridgefield, driving them back to their ships on Long Island 
Sound. 

Afterward, General George Washington made a personal visit to 
Ludingtons' Mills to thonk Sybil for her courogeous deed. Statesman 
Alexander Hamilton wrote her o letter of praise. 

Two centuries later visitors to the area of Patterson, New York, can 
still follow Sybil's route. A statue of Sybil on horseback stands at Lake 
Gleneida in Carmel, New York, and people in thot areo know well the 
heroism of Sybil Ludington. In 1978, a commemorative postage stamp 
was issued in her honor, bringing national ottention to the heroic young 
girl who rode for independence. 



From Cobblestone's Septembef, 1983 issue; "Potfiolit Tales of the A;nericon Revolution." Copyright 1983, Cobblestone Publishing Inc., Peteeborough, NH 03548. 
Reprinted by petmisston of the publisher. 
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A Story on the NAEP Test for 4th Groders (continued) 



1 . What ore the major events in the story? 



2. Sybil 's father thought that she 

a. was obedient but forgetful c. could lead the troops against the British 

b. was courageous and a good rider d. could easily become angry 

3. Co vd a similar story take ploce today? Tell why or why not. 



4. Sybil's ride was important mainly because 

a. she rode about 30 miles c. the British lost at Ridgefield 

b. she was exhausted when it was over d. her mother allowed her to ride after all 

5. The red glow that the Ludingtons watched during supper was caused by 

a. the sunset c. a warning bonfire 

b. a severe storm d. a burning town 

6. How does the author show the excitement and danger of Sybil's ride? 



7. if you had just finished a ride like Sybil's how would you feel and why? 



8 The information about the statue and the stamp helps to show that 

a. people today continue to recognize and respect Sybil's bravery c. the author included minor details 

b. people were surprised that George Washington honored her d. heroes ^re honored more now than they were then 

9. Why do you think the author called this story "Sybil Sounds the Alarm"? 

Uso what you learned in the possage to support your answer. 



33 






SOURCf Willioms. PI. Reese, C M.. Compbell, J.R., Me«eo. J., tind Phillips, G W (199S) 
OepoftmenI of Educohon, Nohonol Cenlei foj Educotion StotislKS 



/ 994 deeding: h fii<>t look— findings Itom ihe Motional /IsscssniCfi^ of fdototionoi Pingm Woshington, DC U S. 



BEST COPY AVAILABLE 



19 




Figure 7 . 




lEA and NAEP Item Overlap 






NAEP Categories 

I I Initial understanding □ Critical stance 

I I Developing an interpretation ■ Personal response 

lEA Reading Literacy Test Coverage 

SOURCE. U S Deportment of Educonon, Nofionol Center for Educotion Stotistics, deeding 
Litetccy fn the United States' lechmcol Jfeport Woshmgton O.C ‘ 1994 



Differing EmphiLses. To cxpKtre the differences between the lEA 
and NAEP tests systematically^ a cemimittee o( experts catego- 
rized lEA items according to NAEP specifications. Their tindinj;s 
are represented in Figure 7^ which shows clearly that lEA test 
items tend to be located in only one of the NAEP catej^ories — 
devektpin^ an interpretation. More than 90 percent of the lEA 
items assess tasks seen in only 1 7 percent c^f NAEP items. Further, 
virtually all the lEA items are aimed solely at literal comprehen- 
sion and interpretation. Items of that kind make up only one- 
third of NAEP reading assessments. 

As compared to the NAEP test, the lEA test measures only 
basic reading processes. NAEP requires students to demonstrate 
these basic skills as well, but also asks for evidence of more com- 
plex levels of understanding. This difference in emphasis 
between the two tests is further illustrated by consideration of the 
distribution of items on a difficulty scale. Ideally a test would 
include items at all points where students can be expected to per- 
form. In rhis way, we could cleady order the performance of stu- 
dents. In the lEA test items did not cover the entire expected 
ability range. Many American students got every item correct. 
Consequently their score on the lEA Reading Literacy Test was 
extrapolated. In contrast, the range of item difficulty on the 
NAEP reading assessment exceeds the ability of most American 
students. Few, if any, students wcuild correctly answer all items. 

One might wonder whether students in the other participat- 
ing countries would do better than American students on the 
standards set by NAGR. There is a high probability that the rank 
ordering or relative performance of countries would remain pret- 
ty much the same.'^' Therefore, it seems reasonable to conclude 
that American students would dc') well as compared to students in 
other countries even if the NAEP test had been administered. 



‘ This statement is denved fioni the theoretic underpinnings al Item Response Theory and its application ta the scaling used 
lor both the lEA Reoding Literacy Test and the NAEP Reading Assessment 
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Comparisons with OECD Nations 

Heightened competition in a global econcMny has stimulated 
public interest in ''world-class standards” tor American students. 
Many policymakers and industrial leaders wc^rry ahcuit our ability 
to maintain our scientific, technolc^gical, and economic edge in 
the world eccmomy into the 21st century. They have pressed for 
the establishment of benchmarks against which the learning ot 
U.S. students cunild be measured, the performance cuir school 
systems monitored, and the naticm’s stcKk (T human capital mea- 
sured over time. 

An internatuM'ial a\’erage might be considered a useful 
benchmark. The lEA study, henvever, dt)es not prt)\’ide the basis 
for a particularly meaningful benchmark. The 32 nations are a 
self-selected group that are neither a representative sample of all 
natuMis nor of our principal trading partners (h^r example, Japan, 
the United Kingdom, and Mexico are not included). 

For the purposes of stimulating further discussion of appro- 
priate world standards, we have capitalized on the fact that 18 of 
the 32 nations participating in the study are also members of the 
Organization for Economic Coc^peration and Development 
(OECD)"^' to construct an OECD average. Using the OECD 
average as a reference pt)int, we can make ccm'iparisons of the 
performance of American students cn’erall, and that of particular 
American subpopulations, against a meaningful benchmark. 



’Ihe OrgnniZQtion lor Economic Cooperation and Development includes the following countries that participated in the lEA 
Reading Literacy Study: Belaium, Canada, Denmark, Finland, France, Germany, Greece, Iceland, Ireland, Italy, the 
Netherlands, New Zealand, Norway, Portuaal, Spain, Sweden, Switzerland, and the United States. The remaining, nonpartic- 
ipoting OECD member countries ore Australia, Austria, japan, Luxembourg, Mexico, Turkey, and the United Kingoom. 
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American Students and the OECD Average 

Figures 8 and 9 show the distribution of reading comprehen- 
situi scores tor American 4th and 9th graders, respectively, in 
each of the three domain^ ot reading. The U.S. mean is higher 
than the OECD mean in each instance, and the difference is sta^ 
tistically significant tor all except 9th grade dtKuments compre^ 
hens ion, These differences are reflected in the percentages of the 
U.S. student populations performing at or above the OECD 
mean — about 60 percent oi 4th graders in the narrative and 
expository domains and 70 percent tor documents. 9th 
graders the parallel figures range between 52 and 55 percent. 

Apparently, American 4th grade students learn basic reading 
skills better than do their peers in other OECD countries. 
Howe\’cr, American 9th grade students do not hold as large a 
comparative advantage relative to their peers in other OECD 
countries. 



American Subpopulations and the OECD Average 

Concerns about inequities in the American educational system 
have aroused interest in how various sectors of the student popu' 
latitm tare in school. To examine that issue, Figures 10 through 
19 illustrate the average levels of reading comprehension found 
in subpopulations defined by race/ethnicity, gender, parents’ edu' 
cation, family wealth, and family structure. These displays allow 
comparisons between the subpopulation groups themselves and 
of each with the OECT’) mean. 

Before proceeding to the.se findings, a note on how to read 
Figures 10 through 19 may be helpful. In each of the figures, we 
show twt^ kinds of mean scores: a single mean for the OECD 
countries, represented by a broken horizontal line across the fig' 
Lire; and a mean score for each of the subpc^pulation groups exam^ 
ined. Each estimate of the group mean is shown as a white hori- 
zontal line within a vertical shaded hand. The shaded area indi- 
cates the confidence interval of the mean — the range in which 
the true mean score of that subpopulation group is most likely to 
occur. When the shaded areas for different groups do not overlap, 
the two groups are significantly different. Uenerally, if the two 
shaded arc. is do overlap, the two groups are not significantly dif- 
ferent. However, if the overlap is small, the groups may still be 
significantly different and a significance test can be done to deter- 
mine significance. 
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Figure 9: 



Distribution of 4th Grodo Reading Achievement Scores 
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Distribution of 9th Grade Reading Achievement Scores 
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Race/Ethnicity. Figures 10 and 1 1 Jisplay the mean pertor- 
mance levels of the three main racial/ethnic groups identified in 
the study — whites, blacks, and Hispanics.* * These data make it 
clear that at both grade 4 and grade 9 the performance of the 
average white student significantly exceeds that of the average 
black student and the average Hispanic student in each domain 
of reading comprehension. Differences between the two minori' 
ty groups themselves reach statistical significance in only two 
instance.s — among 4th graders, where Hispanic students do bet- 
ter than black students on narrative and documents comprehen- 
sion. These findings confirm a pattern that emerges in most stud- 
ies of school achievement in the United States, and one that is 
seen in the 1992 NAEP Reading Assessments.*' 

In both grades 4 and 9, the data also show that the average 
white student always does better than the average OECD student. 
In fact, about 70 percent of white 4th graders equal or exceed the 
OECD average in each domain of reading comprehension. White 
U.S. 9th graders do nearly as well; about 60 percent of them di> as 
well or better than the average OECD student.** 

The a\'erage black student, however, fares less well in the.se 
comparisons. The mean perfi>rmance of black 4th and 9th graders 
is always below the OECD mean, and the differences are statisti- 
cally significant, with one exception (4th grade narrative com- 
prehension). Seen another way, the.se data point out that less 
than 40 percent of Hack 4th graders are the equal or better of the 
average OECD student in their comprehension of text. At 9th 
grade, the comparable figure is 30 percent or le.ss. 

For the most part the a\ erage Hispanic student reads at about 
the same level as the a\’erage OECD student. However, the data 
do show that for 4th grade narrative comprehension they do sig- 
nificantly better, and for 9th grade documents comprehension 
they do significantly wor.^e. In fact, close to 50 percent of 
Hispanic 4th graders and .■somewhat less than 40 percent of 
Hispanic 9th graders read as well or better than the ai'erage 
OECD student.*** 



' While the gioups Astoii/Pocilic Islanders and American Indian/Alaskan Natives were identified in the sample, their num- 
bers were smail and are emitted from consideration in this reporti details on these groups ore provided in Reodino Litsiocv in 
the United States: Jechnica! Hepoit. 

* 'In most instonces the situotion is similar on eoch of the three domains of reading comprehension. To simplify the discus- 

sion, we often describe all three domains with o single approximate stotement such os this. 

’ The significance tests used take into account that there are multiple .omporisons being mode A more stringent (flterron 
IS opplied under these circumstonces This moy result in a group thot oppeors in the figures to differ from the OECO mean 
not ochieving stotisticol siqnificonce when tlie multiple comparisons ore accommodated, os is the cose here for 9th grade 
noitotive for Hisponic students This opparent onomoly appears in severol places thro';.;;iou! this volume. In each cose the 
conclusions in the text ore bosed on the oppropriote tests of stotisticol significonce. 
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4th Grade Narrative, Expository, and Documents 
Scores by Race/Ethnicity 



9th Grade Narrative, Expository, and Documents 
Scores by Race/Ethnicity 
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SOURCE: U.S. Deportment of Education, National Center for Education Statistics, 
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Findings such as these highlight the persistent problem of 
racial/ethnic educaticnial disadvan:,-.ge within the United States. 
This disadvantage takes on additional meaning through compare 
istnis with the OECD average. Our sense of fair play and our 
international ctMnpetitiveness both suffer in the face of a situa^ 
tion where 60 to 70 percent of white students score at or above 
this OECD average, but only 25 to 40 p<.^rcent of black students 
ami 35 50 percent of Hispanic students achieve the same stan^ 

dard. The prtiblem takes on even greater importance when we 
ctmsider htnv quickly our mincer ity pc'^pulation is growing. 

Qender, Figures 12 and 13 display the average reading per- 
tormances 4th and 9th grade K^ys and girls in each of the three 
domains. Historically, girls ha\^' outperformed boys when the 
task involved the reading ot stories (narrative text), and the data 
tend U) ctmhrm this obser\-ation. AmcMig 4th graders, girls do bet- 
ter than boys on narrative and expository but not dcKuments 
comprehension. At 9th grade, females exceed males only in nar- 
rative comprehension. 

Both 4th grade boys and 4th grade girls do consistently bet- 
ter, on average, than the average OECD student. Among 9th 
graders, girls better the OECD mean on narrati\’e and expository 
compreliension. In comparison the a\'erage U.S. male 9th grader 
differs significantly from the average OECD student only with 
respect to expository comprehension. 

FrcMTi the perspective c^f how many U.S. students do as well 
or bettor than the average OECD student, the situation is as fol- 
lows. In order of ihe three reading domains tested (narrative, 
expository, documents) the percentages of 4th grade girls at or 
above the OECD mean are 61, 65, and 60 percent. The compa- 
rable figures fc^r 4ih grade boys are about 60 percent. At the 9th 
grade, the pattern is similar but the advantage is smaller The per- 
centages c^f girls and Ix^ys at or exceeding the OECD mean in 
each domain are as follows: for girts, 61, 53, and 53 percent; for 
boys, alxHit 50 percent in each case. 
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Figure 1 2 



4th Grade Narrative, Expository, and Documents 
Scores by Gender 



Figure 13 



9th Grade Narrative, Expository, and Documents 
Scores by Gender 
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Parents^ Education and Family Wealth, The connectu>n 
between school learning and parents’ social and economic sta- 
tuses is well established. Parental occupation and education fig- 
ure prcMuinently as indicators ot vSocial status, while income is 
often ccMisidered a common indicatc^r of economic status. Given 
the widespread concern about the effects ot educational, social, 
and eccn'iomic disadx'antage in A.merican life, we examine the 
linkage cT parental educaticM'ial and eccmomic attainments to 
readinjj comprehension. 

Students’ reports of their j)are7Us' education levels are the best 
measure of social status available to us. The mean reading scores 
for each of several steps on the ladder of educaticmal attainment 
are presented separately for father's and mother’s education in 

Figure 14 and IS 

Irrespective of whether we consider father’s or mother’s level 
of education, the relationship between the social status of the 
family — and hence of the student — and the student’s ability to 
comprehend written text is straightforward. In general, as the 
education level ot the student’s parents increases, so does the stu- 
dent’s own level of reading comprehension. For the purposes ot 
the discussion that follows we tocus on mother’s education; how- 
ever, essentially the same findings hold for tather’s education. 

Fourth graders whose mothers have not completed high 
school are the only cn^ies whose average level ot reading compre- 
hension does not exceed the OECD mean. E\*en sc\ the average 
student in this group reads at aK^ut the same level as the average 
l^ECD student. 

Among 9th graders, howe\*er, this same group of students 
reads consistently less well than the typical OECD student. 
Ninth graders whc')se mothers have ccanpleted high school read at 
about the same level as the average OECD student and, tor the 
two highest education groups, at a level on average above that of 
the typical OECD student (with one exception — Llocuments 
comprehension tor the lower ot these twi^ groups). 

From the perspective of the pri^portions ot students who do 
as well or better than the average OECD student, among 4th 
graders whose parents are college graduates, two in every three 
equal or exceed the OECD average. At the other end of the par- 
ent education range, some 40 to 50 percent equal or better the 
OECD mean. In the 9th grade, only about one in three ot such 
students reads at or above the OEC'D average. 
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4th Grade Narrative, Expository, and Documents 
Scores by Parents' Education 
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9th Grade Narrative, Expository, and Documents 
Scores by Parents' Education 
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A similar pattern emerges when we consider family wealth. 
Using an indirect measure of family wealth, we have defined four 
groups based on quartiles* — students in the lowest 25 percent 
we call poor; those in the highest 25 percent we call rich; those 



tiles 2 and 3. The mean performance levels of 4th and 9th graders 
in each of the three domains, by level of family wealth, are shown 

in Figures 16 and 17- 

The relationship between family wealth and reading compre- 
hension is clear: reading comprehension appears to increase as 
the level of family wealth increases. For 4th graders in every 
domain, the poor are outperformed by eveiyone else, quartile 2 
outperf(^rms the poor but is exceeded by quartile 3 and the rich. 
While those in quartile 3 and the rich outperfc^rm everyone else, 
there are no differences between them. For 9th graders the poor 
are always outperformed by the rich and are outperformed by 
those in the third quartile on narrative and documents, and they 
are also outperfc^rmed by those in quartile 2 in documents. 

Despite the consistent degree of disadvantage associated with 
being pcx^r relati\*e to their wealthier peers within the United 
States, the average reading performance of this most economi- 
cally disadvantaged group never falls significantly below the 
OECD a\’erage. Further, in all family wealth groups other than 
this one, for all three domains and bc^th grade levels, the average 
student’s perf(^rmance always exceeds that of the average OECD 
student. 



* An indirect measure of family wealth based on household possessions was used in this instance The four groups shown 
were defined fay quartiles on the distribution of this meosure with poor being the lowest quortile and rich the hignest. 



in the second and third quartiles are simply designated as quar- 





Figure 16 



4th Grade Narrative, Expository, and Documents 
Scores by Fomily Weolth 



, Figure 17. > 



9th Grade Narrative, Expository, and Documents 
Scores by Family Wealth 
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Family Structiire* Durinfj the past few decades, the number of 
families that differ frcMU the traditicM'iai two-parent, nuclear fam^ 
ily has dramatically increased with presumed negative conse- 
quences for children s learning. In the analyses below we exam^ 
ine this issue by looking at how the level of reading comprehend 
sion differs anumg children from different family structures. 

Fc^ur family configurations were identified from the students’ 
reports of other people present in the same household and their 
relationships to the student. Thus, the distinction between bio- 
logical parents and stepparents or guardians is one based on the 
students' perceptions. 

■ Two-'l^arent biological families — both biological parents are 
present. 

■ Tuv-parent blended families — one or both of the parents is 
a stepparent or guardian. 

B One'parent mothcr'07ily families — single-parent families 
headed by mothers. 

fl Other — father'Only families as well as enher configurations 
not described abo\'e. 

Figures 18 and 19 shenv the trends in average levels of 
reading achievement acrerss the tour different family configura' 
tions, and although the average level oi reading ccMiinrehension 
has a tendency to decrease as one moves from the twevparent cat' 
egt^ries acrexss to the "other” category, especially among 9th 
graders, there is considerable overlap between the four family 
types. 

Among 4th graders, two-parent biological families have an 
apparent advantage over all other kinds c^f family structure. This 
difference is significant fi^r all three dcMiiains, with the exception 
that students of two-parent biological families dc^ not differ sig' 
nihcantly frcMn the cM'ie-parent mothet'Only group on the narra' 
tive scale. CtMiiing fnnn a twtvparent blended family appears to 
tTfer no advantage relative t<^ li\’ing in a onC'parent mother'only 
family structure. The family structure that appears to have the 
Icnvest mean achie\^ement is the one we have labeled as 
"other” — families that students say have enher combinations of 
adults with varying degrees i^f relationship ti^ the student. In all 
except cM'ie comparison, these students do not read as well as stm 
dents tnnn luher family types. 
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4th Grade Narrative^ Expository, and Documents 
Scores by Family Structure 
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9th Grade Narrative, Expository, and Documents 
Scores by Family Structure 
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Family structure appears to play a less important role for 9th 
graders. For the most part those 9th grade students who come 
from cuher families seem to he at a disad\'antage as compared to 
their peers in two-parent biological and Mended families. 
However, their level of reading achievement does not differ sig- 
nificantly from that of students in one-parent mother-only fami- 
lies. Ninth graders in one-parent mother-only families do not do 
as well in expository comprehension as those in two-parent bio- 
logical families. 

As compared to their peers in OECD countries, the average 
4th and 9th grader from a two-parent biological family exceeds 
the OECD average, as do 4th graders from two-parent blended 
and one-parent mother-only families. Students from families des- 
ignated “other’' do not exceed the OECD average and even fall 
below it in one instance (documents comprehension at grade 9)., 
Among 9th graders those from one-parent mother-only families 
on average do not read better or worse than the typical OECD 
student. 

In terms of the numbers or proportions of students at or ahcn'e 
the OECD mean, where less than 50 percent of 4th graders in the 
other group meet or exceed the OECD average, 55 to 70 percent 
(rf students from the remaining three family structures achieve this 
status. For 9th graders, the analogous percentages of students 
equaling or exceeding the OECD average in each domain are 5 to 
20 percentage points lower than those for 4th graders. 

The message emerging from these comparisons appears to be 
consistent with the belief that two-parent biological families 
offer children some advantages over cnher family structures, 
though the advantage is relatively minor for all groups except the 
configuration identified as “other”. The ad\^antage is most appar- 
ent among 4th graders. We explore this matter further in analy- 
ses reported below. 



American Reading Literacy Achievement in an 
International Perspective 

It is indisputable. American 4th and 9th ttrade students read well 
compared to their counterparts in the countries taking part in the 
lEA International Reading Literacy Study. Although the lEA 
test may not have stretched this country’s students tii their max- 
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imum, American students have, cm the whole, turned in a cred- 
itahle performance. We also know that compared to OECD 
countries, American 4th and 9th ^rade students frequently do 
better than simply holding their own. While 4th graders consist 
tently exceed the OECD average, U.S. students at the 9th grade 
dc^ not hold as large a comparative advantage — their achieve^ 
ment is not consistently superior io that of students in OECD 
nations. By this standard the only markedly disadvantaged groups 
in the United States are blacks and students whose parents have 
low levels of education. 

By our own standards, however, we see educational disad' 
vantage more brcmdly in the differences between American sub' 
population groups. The typical white student has a higher level 
of reading comprehension than the typical black or Hispanic stu' 
dent. Females read and comprehend narrative text better than 
males. Students whc')se mothers or fathers have a college degree 
read better, for the most part, than students whose mothers or 
fathers have failed to complete high schcml. Students whose fam^ 
ilies are poor do not read as well as thc'jse whose families are bet' 
ter off. 

These relatively simple demonstrations cT differences among 
subpc)pulation groups suggest social, educational, and econc'^mic 
di>advantage at work. But this simple picture hides some com' 
plexities. For example, these separate aspects of disadvantage are 
often confounded with each other. Racial/ethnic disadvantage, 
for example, ohen contains a large component of socioeconomic 
disadvantage. Poor families are more likely to be those in which 
parents also have low levels of education. OnC'parent mother' 
only families are nu^re likely ro suffer eccmomic disadvantage 
than twcvparent families. And so on. In the folKnving pages, we 
set forth another series c^f analyses designed to disentangle stune 
o\ these multiple aspects of advantage and disadvantage. By so 
doing, we ht>pe ro come a step closer to identifying sc^me o\ the 
reason> why American students vary in their capacity to read and 
understand written text. 
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nations, differ in their average levels of reading comprehension 
serves as an initial indication oi whether there may he a problem 
in an education system. As shown in the preceding section of this 
report, amon^ the nations participating^ in the lEA International 
Readinj^ Literacy Study, American students on average do as well 
as or better than most, and even our most disadvantaged student 
primps read well compared to the a\'eraye OEC'D student. Still, 
not all U.S. students understand written text equally well and 
some readily defined student groups differ substantially from each 
other in this respect. 

Findings that show within-nation differences between student 
groups raise questions. For example, are all student ^Toups bein^' 
provided equal access and opportunity to learn? Considerations of 
this kind drive research that seeks to explain why groups of U.S. 
students differ in their reading comprehension. 

In this section of the report, we move closer to account in<z for 
differences between U.S. student groups in their reading' compre^ 
hension. We build (Uir explanatiim frem very basic elements — 
the relaticmships between reading cemprehension and a variety 
of attributes of students, families, communities, sclunds, and 
teachers. Prior research and experience have led us to believe 
that the selected variables are each likely to make a difference in 
the development of these necessary readinj^ comprehension 
skills. But any one variable, in and of itself, will nt)t explain ^roup 
differences. Instead, each of these variables opera te^ within a web 
of relationships, all acting .simultaneously and in ways that inter- 
act with each other. For example, the differences in achievement 
between racial/ethnic groups may in part be attributed to associ- 
ated socioeconomic differences. Statistical procedures make it 
possible to disentangle the effect of each variable from other 
related variables. In this way we can consider the effect of each 
\ anable uncomplicated by confounding^ variables — we can look 
at the effect of racial/ethnic differences separate from other vari- 
ables such as family wealth. 

In the pa^es that follow, we have condensed hndinus from 
the larger set of analyses reported in Reading Literacy in the I nited 
States: Technical Re/>ort. In the interests o\ a simplified presenta- 
[\on, we have limited our vlata displays and discussion to narni- 
tive ctmiprehension amon^ 4th graders. With this as the focus, 
we look at its relationship to aspects of family background and 
vlisentan^le the webiif relationships by statist ically isolatinu each 
vari.ible fnnn i»ther related varialdes in order to estimate the 
effects of each variable as purely as possible, uncomplicated by 
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contiuindin^ influences. For example, we take out the part of 
racial/ethnic differences that is due to parallel socioeconomic diF 
terences. Similarly, we look at aspects of proxdsion within schools 
and separate out that part due to provision akme from that part 
due to attributes ot students themselves. 

The discussion here centers on twti basic sets of influences: 
(1) family influences on students, and (2) schools and communi' 
ties as they influence both teachers and students. Usin <4 a large 
array ot variables from both categories we constructed a twodevel 
model ot factors related to reading achie\'ement. We have chosen 
to highlight the influence of four salient student and family vari- 
ables — family structure, family wealth, race/ethnicity, and par- 
ents’ education. Similarly, the discussion of community and 
schocd attributes is narrowed to three — parent invoK'ement in 
the school, instructional time, and class size. In each case the 
unique relaticmship shown becomes apparent because of statisti- 
cal controls on the full spectrum ot variables listed in Exhibit 4. 

Each presentation consists of two \*iews ot the highlighted 
relatiimship — observed averages based directly on the data as col- 
lected, and adjusted averages, which are an estimate of what the 
observed averages wiuild be, other things equal. Ot/ier t/imgs eqital 
means that we have statistically manipulated the data so that the 
effects ot all the other variables listed in Exhibit 4 do not enter 
into the relationship being presented. Further, the performance 
of each subpopulaticni is shtnvn relative to the overall average. 
Thus, one can readily see which groups do better or worse than 
U.S. students as a whole. 



Exhibit 4 



Vorfobbs \ mk M ii tb U.S. lEA AMlysts 

StiNbtf Atfrihitts oge, gendir, rocg/ithnkity, 

mothtr tongue 

FoMily Attribvtf s family structure, (other's and 

mother's educotion, fomily weobh 

Comwiiity AttrSHftee region, community resources, 
porentoi involvement 

School omi Close publk/privote, minority compost- 

AttHbotes tion, instructionol time, librory ■ 

resources, speciolist staff, prince 
pal's leodership style, doss size 



Family Influences 

Given the amount ot time children spend at home before they 
begin school and, later, outside of school hours, it is not surpris- 
ing that the Commission on Reading reported that 
roles of inc“^timahle importance in laying the foundation for 
learning to read,"**^ There have been numerous studies related to 
family structure and school-related performance. Family structure 
has been looked at from many perspectives. These have included 
the number ot parents in tlie home, the family size, the birth 
order, and gender distribution. These variables have been con- 
sidered in relation \o changes in economic status, parental time 
,i\ ailahility, and parental role models. In addition, the reasons tor 
a particular family configuration, perhaps due to divorce or death, 
are considered to have an important impact on schtKil-related 
performance. 
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Family Structure 

Over the past three JecaJes rlie structure c)f American families 
has chanj^ed dramatically. The picture ot the nuclear iamily as a 
father, mother at home, and twc^ children is hein^» transformed as 
divorce rates, the number of children horn ro unwed mothers, 
and the number c^f mothers entering the labor force climb. The 
annual number of divorces increased approximately 120 percent 
between 1965 and 1989, and about 1 million children are 
invid\'ed in divorces each year.*'^ While overall birth rates have 
been declining since 1950 (106.^ live births per 1,000 women in 
1950 to 65.0 live births per 1,000 women in 1988), the number 
of births to unmarried women has been increasing (14d per 
1,000 live births in 1950 to 58.6 per 1,000 in 1988).^^' And the. 
labor force participation of women with children under 18 years 
of age has markedly increased from 1 1.8 million in 1970 to 22.5 
million in 1991. As divorce, remarriage, and single-motherhood 
increase, and as women maintain their jobs throughout the peri- 
od of child rearing, the families in which children learn to read 
take on an entirely new profile when compared to past genera- 
tions. 

Obser\’ers usually think the changes we are witnessing in 
American families have a negative impact on children s literacy 
development because they may reduce the level of parent-child 
interaction thought crucial lo early language development and 
later progress in reading skill. Studies in support of this position 
are common. As a whcde, the ex’idence suppc^rts the hypothesis 
that children of intact families do better than those in families 
where the parents have remarried.*' While the research and lit- 
erature as a whole tends in this direction, more recent work rais- 
es concerns about the validity of this position.*^ 

As noted earlier four categories of family structure were dis- 
tinguished: 

■ Two-lmrent hioto^fj^icat families — both Isiological parents are 
present; 

■ Tu'o-parent Wended families — one or boih of the parents is 
a stepparent or guardian; 

■ One-pureni mother-only Jamilies — single-parent famib s 
headed by mothers; and 

■ ( )ther — father-onlv lamihes as well as olher configurations 
not described above. 




Figrre 20 ^hows the relatumship between family structure 
and narrative ccnnprehcnsion tor 4th graders from the tour types 
of families. The sidid bars represent the observed avera^^e score tor 
each ot the fi^ur student ^nnips. These mean scores are shown reh 
ative ti') the average score for all 4th graders — the horizontal hrtv 
ken line across the ^raph at zero on the compichensicm scale. 

Althouj^h these mean scores may not he significantly difterent 
from one anothen it appears as it the observ ed mean {or two^par^ 
ent hiidogical and one^parent mother-only tainilies are above the 
average tor all students, while those tor twevparent blended and 
other families are below. Similarly, it appears that students trom 
two'parent biokigical tamilies do best, those trom one-parent 
mother-only families are next, children trom two-parent blended 
families are third, and those in other ^roupint^s show the lowest 
pertormance. 

In terms of the statistical significance of these observed dit- 
ferences, 4th graders from all family confij^urations comprehend 
narrative better on average than students from the '‘other” cate- 
gory, and the two-parent biological conti^urarion seems to confer 
an advantage on children in this respect relative to the two-par- 
ent blended families. However, 4th j^raders from one-parent 
mother-only families ctnnprehend narrative text at about the 
same level as 4th graders from either of the two-parent conhyu- 
rations. 

The shaded bars in Figure 20 represent the parallel adjusted 
means, estimates oi what the observed means would be it the 
variables listed in Exhibit 4 were factored out. Put another way, 
these are estimates o( what the average reading comprehension ot 
each Mtoup would be if all the students were equally wealthy, 
came from families with identical educational and social back- 
j^rounds, attended the same kinds ot schools, and so on, ditlerin^ 
only in the structure iTtheii family. 

Under these ciniditioi^s, we see that children trom one-parent 
mother-only families do better than we mi^ht expect trom simple 
observatitm akme. Separating* out the vlisadvantaj^es associated 
with sin^le-nuuher families in the population as a whole su^^ests 
that children fr^nn these families do better than those trom two- 
parent bitdo,uical families, but the difference is not statistically si^- 
nilicant. And, in fact, 4th graders from one-parent mother-only 
tamilies do have higher leveU of narrativ'e comprehension than 
stuvlents in two patent blen led and other lamilv ivpes. 




Family Structure: Observed and Adjusted 
Relationships; 4th Grade Narrative Score 




NOTE; The soli'' l orsshow the observed diHerence between the cctegorY overoge and 
the overoge for the total group. The shaded bars provide on estimate of this some 
difference adjusted stotisticallv for other related influences shov/n in Exhibit 4. 

SOURCE. U.S. Department of Education, National Center for Education Stotistics, 
Ming Urerocy tn the United States: Jechnicol Mtt- Washington D C.: 1994. 
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Family Wealth: Observed and Adjusted Relationships; 
4th Grade Narrative Score 




(poor) (rich) 

NOTE: The solid bars show the observed difference belweei] the category overage ond 
the average for the total group. The shaded bars provide on estimate of this same 
difference odjusted stotisticolly for other reloted influences shown in Exhibit 4. 

SOURCE: U.S. Deportment of Educotion, Notionol Center for Educotion Stotistics, 
Reoding literacy in ifie United States: Jechnical Report. Woshington O.C.: 1 994. 
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The obverse c^f this holds for Z-parent biological families; 
separating out their social and economic advantages, broadly 
conceived, suggests that this configiiraticMi per se coffers less real 
advantage than we might have suspected. For other family con- 
figurations, the data suggest that the apparent disadvantages are 
not as pronounced when we take intc^ account the range of relat- 
ed variables listed in Exhibit 4. Tests of statistical significance 
make one thing clear; 4th graders living in family configurations 
other than two-parent or one-parent mother-only are consistent- 
ly disadvantaged with regard to narrative comprehension. 

Family Wealth 

Simple observation and evidence suggest that po\'erty is general- 
ly a handicap for students in school. Children from low- income 
families are less likely to attend prekindergarten programs than 
children from high-income families. They are more likely to 
repeat a grade and to drt)p out if they had repeated than those 
from middle- or high-income families. In high school, a higher 
percentage of students from low-inccnne families drop out each 
year, a fact reflected in the larger percentage of 19- to 20-year- 
olds from low-income families out of school without high school 
diplomas. Further, it is often argued that differences in family 
income acccuint for much of the difference in dropout rates 
between racial and ethnic groups.*-*^ 

However, the situation may not be quite as simple as it 
appears. Differences in family wealth are paralleled by differences 
in a \'ariety of other attributes of students’ families — race/ethnici- 
ty, for example. While 16 percent t)f white children live in pover- 
ty, 39 percent of Hispanic children and 46 percent of black chil- 
dren do.^' Similarly, differences in parental educational attain- 
ments, and in the structure of families, are also related to differ- 
ences in family economic circumstance. It follows that the 
observed reading comprehension deficit of pex^r children may not 
be due solely to pewerty. Other family attributes related to family 
wealth may play roles that, without careful ctn'isideration, may be 
wrongly attributed to wealth. 

A comparison of the ohsewed and adjustrd mean.s in Figure 21 
offers .some suppt^rt ft^r this notion. Again, the solid bars depict 
the okserved group means as deviatitms from the population mean, 
and the shaded bars represent the adjusted means in the same way. 
In terms of the observed means, we sec that students from poor 
fimilies on average score 27 points below the mean for all stu- 
dents. Students from rich families have an average comprehen- 






sion sa>rc 15 points above the average of all students. Thus, the 
^ap between the poorest and richest is o\'er 40 points. At first 
look, then, 4th graders from poor families are at a decided disad- 
vantaji’e in terms of their comprehension of narrati\'e prose. 

This view of the effects of hein^ poor is modified, however, 
when we factor out the effects of confounding variables (all other 
variables listed in Exhibit 4). The adjusted category means shou'n 
by shaded bars indicate that, other things equal, the poor are not 
as disadvantaged, nor the rich as advantaged, by family w'ealth 
per se as simple observation might lead us to believe. Ne\'er- 
theless, even after adjusting for those related influences shown in 
Exhibit 4, the gap between the rich and the poor remains, hut at 
15 points rather than 42."^' 

Race/Ethnicity 

The grc'wth of racial and ethnic diversity in the United States is 
mi)st evident in the nation’s schools, where the minority student 
population has increased from 24 to 33 percent, and the propor- 
tion of Hispanic students doubled, in the period betw'een 1976 
and 1991.^*^ One in every two of these 114 million minority stu- 
dents lives in "•overty."'’ Most minority groups suffer some degree 
of educational disadvantage — lower high school completion rates 
;md lower levels of college entry. 

The achievement deficit of minority students shows up with 
respect to reading comprehension. Figure 22 shows clearly the 
differences in ax'erage reading comprehension levels across the 
three racial/ethnic categories in the form of observed and adjusted 
means for narrative comprehension among 4th graders. The 
observed means, shown as solid bars, indicate that whites, on 
average, score 15 points abow the narrative comprehension 
mean for all 4th grade students, the average black student scores 
50 points below this national average, and the average Hispanic 
student, 27 points below. As noted earlier, this pattern of disad- 
vantage in reading Cvimprehension is consistent across the two 
grades and the three comprehension measures. 

A variety of explanations have been offered tor this pattern 
of disadvantage: it is a reflection of the fact that minority status 
is confounded with socioeconomic statusp^' beiween-group dif- 
ferences in achievememt motivation, aspiration, and expecta- 
tiims are responsible;"' or it reflects differences in child-rearing 



Figure 22 / 



Race/Ethnicity: Observed and Adjusted Relationships; 
4th Grade Narrative Score 
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NOTE: The soM boR show the observed diffeience between the cotegoiy overage ond 
the overage for the lotol group Ihe shoded bo5 provide on estimote of this some 
difference adjusted stotislically for other reioted influences shown in Exhibit 4. 

SOURCE; U.S Department of Education. Notional Center for Education Statistics, 
^eodfog liteioty in the United States: lechnica! Hepott. Woshington D.C.: 1 994. 
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* From the standpoint of statisticol sigmficcnce, the adjusted mean for the poor is reliably different from the means of quor- 
tile 3 and the nth, but quartile 7 The letter thiee groups do not differ signifitnntly from ooth other. 







practices.-^ Some explanations place responsibility on school 
practices such as isolating black students in separate classes or 
providing them a lower level of instruction/^ Also, many teach- 
ers and administrau^rs believe that minority children cannot or 
will not learn. Thus, some researchers believe that these low 
expectations become a self-fulfilling prophesy. A similar line ot 
argument has focused on the disparity between the culture and 
the language of the home and that of the school. Some believe 
that hcnne/schot)! differences in conversational patterns, nonver- 
bal communication, and social interactions are strong intluences 
on academic achievement, particularly with regard to reading, 
writing, and forms of argument."'’ 

We can only address these issues in a limited way, to the 
extent of holding a number of confounding factors constant 
(thc\:e identified in Exhibit 4) while looking at the relationship 
between race/ethnicity and reading comprehension. A compari- 
son of the solid bars in Figure 22 identifies an observed difference 
between blacks and whites of a substantial 65 points. Ad/wstmcnt 
fi^r confounding factors reduces this black/white gap by more 
than half, to one of 24 points. Even at that level the difference 
remains statistically significant. Similarly, the observed 
white/Hispanic gap of 42 points is reduced to 12 points after the 
same kind of statistical adjustment, a difference that is no longer 
statistically significant. These analyses suggest that about twcv 
thirds of the gap between majority and minority achievement 
can be accounted for by the other factors listed in Exhibit 4. 

Parents’ Education 

Data in The Condition of Education^^ provide a good picture of the 
relationship between parents' educational attainment and over- 
all student achievement. The pattern is captured in the following 
statistics: when compared to students with ctfilege educated par- 
ents, high school students whexse parents have not completed 
high schend are less likely to be in academic pre^grams; are more 
likely to be in general or vocational/technical programs; have 
lower average academic achievement and lower verbal and math 
SAT secures; and are iru^re inclined to repc^rt lower levels of par- 
ent expectations.^'^ 
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A similar pattern appears f(^r reading comprehension — the 
children of better educated parents tend to read better than the 
children of less educated parents. Figure 23 shows observed and 
adjusted group means using the same format as previously. Irre^ 
spective of whether we are looking at father s or mother s educa^ 
tion» students whose parents have not graduated from high 
school have reading comprehensi(')n scores well below the U.S. 
average. Students whose parents have completed college have 
reading scores above the national average. 

However, we know that welbeducated parents also rend to 
ha\'c higher status occupations, make more money, read more, and 
encourage their children to read. Thus, the differences amcmg the 
tour groups defined by parent’s education may not he attributable 
solely to parents’ educational attainments. Lcx^king at the adjusted 
group means (shaded bars) relative ti^ the observed means (solid 
bars) makes this point clear. The effect o{ parents’ education is 
considerably reduced when confounding variables are taken into 
account. Fc'jr example, an apparent gap ot 47 points between the 
means of 4th graders in the highest and lowest father’s education 
groups is reduced to 19 points after adjustment. While this is still a 
statistically significant difference, it is only 40 percent of the c^h- 
served difference. Similar changes occur in cc')nnecticm with moth- 
er’s education — an apparent gap o( 49 points between the means o\ 
4th graders in the highest and Ic-west mother’s education grcxips is 
reduced to 14 points after adjustment. This is still a statistically sig- 
nificant difference, but ordy 29 percent ot the obser\'ed gap. 

In short, other things equal, students whc'jse parents did not 
complete high school are not as disadvantaged by their parents’ 
educational attainments, and students whose parents have com- 
pleted college are not as advantaged, as it might seem frcnn sim- 
ple observation alone. For either parent the advantages/disad- 
vantages to students of parents’ educatumal attainments ten*..! tc^ 
be located at the extremes — less than high schcnd on the one 
hand and a college degree on the other, thcuigh the differences 
between less than high schocd and more than high schocd are alsc^ 
significant in the cast* of father’s education. 




Parental Education: Observed and Adjusted 
Relationships; 4th Grade Narrative Score 
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Less than Completed More than Completed 

high school high school high school college 




*40 I I I ^ I 

Less than Completed More than Completed 

high school high school high school college 



NOTE: Ifiti solid bcfs show the obsen/ed difference between the category overoge and 
the average tor Hie total group. The shaded bars provide an estimate of this same 
difference odjusted statistically for other reloted influences shown in Exhibit 4 

SOURCE' U S Deportment of Educotion, Notionol Canter for Educotion Stotistics, 
Reading litciocy m the United States fechnicol Repott. Woshington 0 C.. 1 994 
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Families and Reading Comprehension 

The illustrations provided above were limited to a few family sta- 
tus characteristics among those investigated as part of the study 
proper — the educational and economic aspects of socioeconomic 
status> racial/ethnic status, and the parent configuration of families. 

On the whole we were able to make two points clear: first, 
there are substantial differences in the average levels of reading 
comprehension between student groups defined in terms of these 
family attributes; second, these hetween-group differences have 
their origins in many factors rather than one. Disentangling these 
multiple influences to isolate that part unique to each offers a 
slightly different view of the world and one not always in accord 
with simple observation. The configuration of parents present in 
families matters, but one-parent mother-only families per se do 
not appear to disadvantage children in this respect. Racial/ethnic 
differences are large, but much of it is due to racial/ethnic differ- 
ences in education and wealth, among other things. Family 
wealth matters too, hut not as much as we might suppose from 
simple observation. Differences in parental education are also 
important, hut not as important as we might expect, and then 
only at the extremes of educational attainment. 



Community and School Influences 

We now shift attention from the student as an individual to the 
student as a member of a class, within a school and a community. 
Schools are set within communities, w'hich vary greatly according 
to population, resources, and the extent of parents’ involvement 
and cooperation. This broad context serves as the background in 
which the schex)! operates. Within that framework, schools define 
the me immediate context within which students learn to read. 
Their structure, size, resources, scxrial composition, and leadership 
are believed to influence what goes on in classrooms and, hence, 
what students learn. Consistent with this view we look at these 
contextual influences as influences on student classroom groups 
rather than students as individuals. That is, w^e look at the effects 
of community, school, and classroom context on the average 
reading comprehension of students grouped in classes. 

The lEA Iniernational Reading Literacy Study measured a 
number of contextual variables with presumed links to reading 
comprehension. For the purposes of illustrating the findings of the 
study as a whole, we focus our attention on three of these — par- 
ent involvement, instructional time, and class size. As before the 
data presentations are limited in focus to the narrative domain of 
reading literacy among 4th grade students. 



Parent Involvement with Schools 

Parent involvement with schools tends toward one or more of 
three types:^'’ reinforcing at home what is learned in school; being 
part of a closely knit parent'School community where parents join 
in school activities and share a set of common values;^^ and a more 
managerial type of involvement where parents and community 
members have a voice in policy decisions affecting the school.* 

The lEA measure of parent involvement was a question to 
.school principals about the degree of parent support for the 
school’s principles and goals. Response alternatives ranged from 
“much below average” to “much above average” on a five^point 
scale. On the surface the measure seems to tap that form of parent 
involvement supporting the formation of a cohesive family'School 
community. 

The relationship between parental involvement and the read' 
ing comprehension level of classrooms is shown in Figure 24 
where both observed and adjusted means for the narrative compre^ 
hension of 4th grade classrooms are shown for each of the four par' 
ent involvement categories.** The substantial relationship 
between parent involvement for the school and the reading com' 
prehension levels of 4th grade classrooms is obvious. Where 
involvement is low, cla.ssroom means average 46 points below the 
national average, and where involvement is high, classroom.s score 
28 points above the national average — a gap of 74 points. Even 
after adjustment for the other attributes of communities, schools, 
principals, classes, and students that might well confound this rela' 
tionship, the association between parent involvement and class' 
rcH)m achievement remains, though the observed gap of 74 points 
between the twc^ extreme groups is reduced to 44 points. 

Our findings here are consistent with the literature on etfec' 
tive schools; “All other things being equal, schools in which pat' 
ents are highly involved, cooperative, and welbinformed are more 
likely to develop effective organizations than schools in which 
parents do not possess these qualities.” 

Instructional Time 

Instructional time is measured as the hours of instruction that the 
school provides for all subject areas. As such, the measure requires 
rhe assumption that nu>re time available (or learning generally 
results in non* time for reading Instrucrmn and a greater level of 



‘Here, jKifentuI i-^voiverrent is as port ol ttie move toward Sfhoohite management, (ommunitv control, end more con- 
segoenho! porent-schucl poftnet^nips. 

* ‘Since few pnncipois dicoiec support wos ‘'much below overogn.’' we merged this (otegory with that for "balow over- 
uge’ to neote o four-ooint response S(o!e. 




Parental Involvement: Observed and Adjusted 
Relationships; 4th Grade Narrative Score 




Below Average Above Much above 
average average average 



NOTE: The solid bars show the observed difference between the cotegory overogo and 
the overoge for the totol group. The shoded bars pmvide on estimate of this some 
difference odjusted stotisticoliy for other reloted influences shown in Exhibit 4. 

SOURCE: U.S. Deportment of Education, Notional Center for Education Stotistics, 
Reading Liteiocyin the United States: lechnica! Report. Woshington O.C.: 1 994. 
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Figure 25 



Instructional Time: Observed and Adjusted 
Relationships; 4th Grade Narrative Score 




•20 1 — 1 1 

25 or fewer 26-30 More than 30 



NOTE. The solid bois show ihe observed difference belweon the lOtegoiY overcge ond 
the oyctoge for the totcl group. The shaded bars provide on eshmote of this same 
difference adjusted statistically for other related influences shown in cxliioi* <1. 

SOURCE: U S. Deportment of Education, National Center for Educoliori Stotistrcs. 
/feoding literocy in ftie Onfred Stofci. fechnnol Report Washington D C. 1994 




reading achievement, other things equal/^"' Principals' reports of 
instructional time ranged from 20 to 40 hours per week. For the 
purpose of this presentation the full distribution has been cob 
lapsed into three jj[roups: 25 hours or fewer, 26 to 50 hours, and 
more than 50 hours. Figure 25 displays ohserval and adjusted 
means tor narrative comprehension amon^ 4th ^rade classrooms 
tor each ot the three cate^^iries ot instructional time. 

Looking at the solid bars representing the i>hserved means, it 
seems that schools otfering me ire instructional time each week 
also have higher narrative comprehension levels in their 4th 
grade classrooms; however, the difterences between the observed 
means across the three categories are not statistically significant. 

The results of adjusting the.se category means for other poten- 
tially c\>ntounding factors is shown by the shaded bars. The eftect 
i:t this adju.stment is to sugge.st that, cither things equal, 50 hc'iurs or 
me ire ot instructiiin has .scimewhat le.ss ot an advantaging eftect than 
we might suppose, while 25 or fewer hours has mi ire ot a disadvan- 
taging effect that we would expect on the basis of simple oKserva- 
tion. Further, the differences between the 25 or fewer category’ and 
each of the other two categories reach statistical significance. 

Obviously senne of the otlier attributes ot students and .schools 
noted in Exhibit 4 are related to Kith instructional time and read- 
ing comprehension. In the case of schools offering 25 hours or 
week or fewer, the.se factors are .somehow compen.sating fc'ir the 
adver.se effect cif limited time since, if other things were equal, we 
wiiuld expect the.se "low-time" schools to do much worse than we 
observe. Neverthele.s.s, it is clear that in .schools that j^fovide more 
than 5 iuiurs cif .schooling per day for 4th graders, .students learn to 
comprehend narrative text .somewhat better than .students in 
schools where the in.structional day is shorter. 

Class Size 

The relation.shiji between class size and achievement has a lo.ng 
and contentious history in educational thought. The contention 
arises out ot the chi.sh between economics and pedagogy. Since 
teacher salaries make up the greater part of .school expenditures, 
policymakers would prefer large clas.ses if students learned ec|ually 
well in them. C5n the other hand, if effective learning depends 
heavily on teachers being able to interact with students iridividu- 
ally and tailor their approaches to the needs of each student, then 
larger class sizes could be le.ss effective. As class size iiurea.ses, each 
student gets a smaller share ot the finite amount of the teaclier’s 
time. Further, clas.srooin management problems can multiply as 
class size increases, thus reducing the lime teachers can spend on 
the instruction of either individuals or the class as a whole. 
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The literature on this issue is not entirely conclusive, 
although one meta-analysis by Glass and Smith has emerged as 
the most definitive statement on the matter. Their study syn- 
thesized the results of 80 or so studies and concluded that for class 
size to make much of a difference to learning, it had to drop 
below 15 students. Since this is an economic impossibility !or 
most school systems, the Glass and Sit th finding has provided 
tacit support for larger classes. 

The matter did not end there, of course. Opponents have 
argued that Glass and Smith’s evidence was flawed, and to the 
extent that their finding was valid, it was limited to elementary 
school classes.'^'-^ Others have argued that the effect of class size on 
learning varies across grade levels, among subject areas, and by 
instructional methods.'^^ 

Most recently, two major state- level studies have looked at 
the same issue. Indiana’s Project Primetime showed that after 1 
year smaller classes produced significant improvement in reading 
and math scores. However, after 3 years the benefits of the small- 
er classes vanished. Tennessee’s Project STAR showed a one- 
time, one-quarter of a standard deviation improvement in test 
scores for the kindergarten or 1st grade children in small classes. 
Although the initial gain was maintained, scores did not contin- 
ue to improve in subsequent years. 

Both projects tTfered some resolution zo the issue o\ class size. 
Howex'er, in both cases there were many associated factors that 
might have equally affected the results.'^- The analysis reported 
here contributes something ti'> this debate, though the data do 
not suggest that the relationship is a simple one. 

For the purposes of this presentation we grouped class sizes 
iiTto five categories: 15 or fewer, 16-20, 21-25, 26-30, and 31 or 
more. Figure 26 shmvs the u'^ual set of observed and adjusted cat- 
egory means. T’ne observed relatiimship captured by the stdid bars 
suggests a less than straightforward interpretation that holds also, 
though with less force, for the adjusted means. Tests td statistical 
significance indicate significant differences between the (»bseuvd 
narrative comprehension means of classes I'if 16-20 students and 
those with either of 21-25 or 26-30 students. Fourth graders m 
classes of 16-20 students read better, iht average, than 4th gradeis 
in these two categories of larger classes. 

The differences between these class groups persist after statis- 
tical adjustment fi^r the confiuinding influences noted in Exhibit 
4 but fail Xo reach stati‘-lical significance. strictly speaking, we 
arc unable to say (with at least 95 percent certainty) that, other 
things equal, there are differences in narrative comprehension ilue 
xo the size of the class in which a student is liKated. 





Class Size: Observed and Adjusted Relationships; 
4th Grade Narrative Score 




15 16-20 21-25 26-30 31 

or less or more 

NOTE: The solid bo5 show the observed difference between the category overage ond 
the overage for the totol group. The shaded bo5 provide on estimate of this some 
difference odiusted stotisticolfv for other related influences shown in Exhibit 4. 

SOURCE: U.S. Jepartmenf of Education, Notional Center for Education Stotishes, 
Ming liteiocy in the United Stores; Technical Report. Washington D.C.: 1994. 




The inconsistencies in the pattern shown in Figure 26 prob- 
ably reflect the effects of unmeasured influences on class size, 
tracking by ability among them. Since classes of the same size are 
created for different reasons and with students of varying ability 
levels — matters not adjusted tor in these analyses — the interpret 
tations provided must remain somewhat equivocal.*^^ 
Nevertheless, the only statistically significant difference in this 
analysis does favor smaller classes. 

Communities, Schools, and Reading Comprehension 

In our discussions of communities and schools and their capacity 
to foster higher levels of reading comprehension among students, 
we found that three attributes clearly make contributions to diT 
ferences in the reading performance of classrooms: parent 
involvement, instructional time, and class size. 

Having parents actively participating in their children s ele- 
mentary schools seems to make a difference to 4th grade reading 
achievement. This is true even after controlling for parent edu^ 
cation, wealth, attributes of the school, and class size, as well as 
all other variables in our study. Findings like this have led to the 
notion that the creation of a network that ties the parents, the 
ccnnmunity, and the school together will enhance the ability oi 
students to read well. 

A schcx)l that provides more instructional time each week is 
likely to have higher levels of reading comprehension, other things 
equal. As the literature points out, h(')wever, this instructional time 
shc)uld m')t he confused with overall time counted just as days or 
hours. Insmictional time means just that — time devoted to instruct 
tion, not assemblies, lunch, recess, announcements, and the like. 

Our analyses contribute something to the Cinitinuing debate 
on class size. Basically, we find that relatively small classes in the 
range of 16-20 students appear to do better than somewhat larg- 
er classes of 21-25 and 26-30 students at 4th grade and for nar- 
rative c(miprehension. Statistical adjustments {or confounding 
influences leave this pattern intact but render the differences sta- 
tistically nonsignificant so it is not entirely clear what we can say 
about the effects of class size per se on reading achievement in 
the nation s classro(')ms. 

None of these findings may seem especially surprising. 
However, we have demonstrated the impi^rtancc of each separate 
factor free from other confounding influences. School policy- 
makers may find a use for this information as they make decisions 
about school practices and policies. 



this section of the report, we provide a snapshot of 4th 
j^rade reading instruction in the United States. For the most part, 
the majority of students at this level have already learned the 
basics of reading. They can turn the symbols on the page into 
words, phrases, sentences, and ideas. Their teachers are more 
actively engaged in getting students to focus on meaning, to learn 
from what they have read, and to enhance children s ability to 
use information they have read. 

To appreciate what goes on in reading classrooms, it is help- 
ful to understand how theories of teaching reading have evolved 
over the past 50 years. Although research and practice operate on 
different timetables, there is nevertheless a noticeable shift 
toward the newer ways of thinking on the part of many teachers, 
most textbook publishers, and among civic and business leaders 
who press for higher levels of school achievement. We begin with 
an outline of the evolution of thinking about reading, and then 
focus on how closely teachers’ beliefs and practices match evolv- 
ing thought. 

On the surface, it would seem logical to connect teacher 
beliefs and practices to student achievement. However, given the 
cross-sectional nature of the data from the lEA Reading Literacy 
Study, this is inappropriate because we would be unable to 
acccnint for at least 3 years of prior instruction. Therefore, we can 
not attribute success or failure to current teacher practice. 



The Evolution of Reading Theory 

Within the living memory oi a great many Americans, learning 
to read meant learning to reprt)duce, in speech or in writing, the 
authors exact message. Coinciding with this was the view that 
the student is an empty vessel to be filled by parents, teachers, 
and the author/expert who wrote the hook. In this school of 
thought, teaching is the step-by-step transm/,ss/on of kncnvledge, 
arraye^l from easy to hard, fre^n an active te.icher to a passive stu- 
dent. The easy parts are thought to be recognizing words, reading 
sentences accurately, and remembering details. The hard parts, 
which are usually withheld from students until they have cleared 
certain hurdles, are thought to be the ability to make generaliza- 
tions and to apply new knowledge to new tasks. 

In the next stage of evolution, mteruef/Vm. the reader/student 
plays a slightly more active role. The siudeni is asked to connect 



the material read with knowledge learned yesterday, last year, at 
school, or on the street. And so one begins to see a greater inter- 
action between the book and the student, who is increasingly 
encouraged to think beyond the immediate w'ords in the text. 
The interactive approach assumes that the reader must always fill 
in missing information because no text is fully explicit; and that 
filling in the blanks creates an engagement with the new infor- 
mation in the text that helps the student absorb and remember 
what he has read. 

Next came a school of thought that places still greater 
reliance on the reader. The student is not only encouraged tc’) fill 
in the inevitable missing information, but also to notice similar- 
ities and disparities between the text he is reading and what he 
already knows, or thinks he knows, about the subject. It is, in 
essence, a transaction between the reader and the writer. In addi- 
tion, the student is asked to find answers in the text to self-gen- 
erated questions. The student is no kmger seen as an empty ves- 
sel: he or she is expected to have questions in mind and to grap- 
ple with the author about ideas and style. In contrast to the step- 
wise approach of earlier theorists, teachers expect students \.o 
deal with both details and large themes from the beginning. 
What differentiates easy irom hard, according to transactional 
theorists, is the density of the material rather than the progres- 
sion from facts to ideas tc'> generalizations. 

Therefore we arrive at three distinct periods in thcnight about 
reading: 

■ Ttrm.smLssiom where the meaning of the text lies in the lit- 
eral wiirds, which the student is expected To reproduce; 

■ Jtuoaction, where meaning resides with K^th the text and 
the reader, and the student is expected to relate what he 
reads to what he already knows; and 

■ Traasaccion, where na'aning is generated by the reader 
based on information from the text, perscmal kniuvledge, 
and purpose for reading. 

We searched the data from the teacher quest itamaires to see 
how teachers’ beliefs and practices correspond, or fail to corre- 
spond, to these differing views about the teaching of reading, and 
finally, we explored the alignment between teachers’ beliefs and 





actions. 



what Teachers Believe 

The items from the questionnaire about teachers’ beliefs divide 
into two groups. The first group, which emphasizes sequenced 
instruction, is characterized hy the sequencing of reading tasks, 
mastery of prior levels before moving on, an emphasis on accura- 
cy, and strong teacher direction. It is closely aligned with the 
transmission approach discussed above. 

While this stance is likely to be consistent with what phon- 
ics proponents advocate, it is broader than just phonics. Implicit, 
though not specifically stated, is a belief in developmental stages 
that are carefully orchestrated by either the material or the 
teacher. 

Alternatively, the second set of beliefs, which emphasizes an 
extensive exposure to reading, is more typical of the transaction 
approach. These beliefs focus more on what the student does and 
less on what the teacher does. Students are expected to read 
lengthy texts frequently, at home and at school, with little 
teacher direction. Students are expected to play a larger role in 
finding the meaning of what they read and to read texts that they 
themselves have written. Thus there is a greater emphasis on the 
integration of reading and writing. 

Figure 27 displays 4th grade teachers’ respcmses to a series 
of statements concerned with the nature of reading. They were 
asked to indicate the extent of their agreement on a five-point 
scale — strongly agree, agree, uncertain, disagree, and strongly dis- 
agree. For the purposes of this presentation we have collapsed all 
except the uiTcertain category into two by dispensing with the 
distinction between strongly agree and agree on the one hand, 
and disagree and strongly disagree on the other. Teachers 
responding that they were uncertaiiT were omitted from these 
analyses and, as a result, the percentages in Figure 27 do not add 
to 100. Further, the statements themselves have been separated 
into two groups; those that relate to a transmissicm emphasis and 
those that indicate a transaction orientation. 

The results are fairly clear; with only a few exceptions, teach- 
ers disagree with items that represent a transmission approach 
and agree with the items characteristic of the transaction 
approach. So, on the surface at least, teachers see »*eading as a 
process of transaction between the reader and the lext — a trans- 
action between textual information, persoiTal knowledge, and 
personal molivation. 
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Figure 27 



What Teachers Believe 



hs/rvcf*M **rr«is«testo 

Riding learning imittriok should be corefullys«qMncid in terms of 1^^ 

Most of what students rood $lK)uld be Qss^ 

Every nustoke o student mokes in reading should be corrected ot once 

Teochers should carefully follow the sequence of the textbook 

Teachers should ohrays group students oaonkng to their reoding obilify 

Ail students' comprehension assignments should be (orefultynrarked to provide them wHhfeed^ 

Students should not start a new book until they hove finished the lost 

When my students rood to me, I expect them to read every word accurotely 

doss sets of graded reading moteriols should be used os the basis for reoding progrom 

Students should learn new words from lessons designed to enhance their vocobulory 

Teachers should keep coreful records of every student's reoding progress 

A word recognition test is sufficient for ossessing students' reoding levels 

Students who can't understand whot they reod hove not been taught proper skills 

9-yenr-olds should not hove access to books they will read next yeorot school If 

fxfewsfve Expeswe to " Urouaettim 

Students should take 0 book bcoie to read every doy 

Every day students should he reod to by the teacher from Q story book 

StudenhshouMoiwoysunderstondwIwt they ore reodkig 

Ail students should enjoy reodini 

Students should be encouraged to reid texts they hove written 

Students should always understand why they ore reodng 

MeststudiiWiinprovtthehreadinibyexlfnstvereadngenthew 



Disagree Agree 




NOTE; Peftenlages do not odd to 100; Itie shoftfoll is due to teochers checking 'uncertain' os a response. 

SOURCE. U.S. Department of Education, Notional Center for Education Statistics, Ming liteiocyin the United States: lechnicol Report. Woshington O.C.: 1994. 
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what Teachers Do 

The essence of the survey questions ah^^ut teachers’ practices is 
teacher control. D'^es the teacher entirely dominate the proceed- 
ings, or share control with students, or center instruction around 
independent student activities? Questionnaire items relating to 
these issues were grouped statistically to indicate three general 
orientations toward teaching practices, namely whether these 
practices were, respectively, materials directed, sk'xred direction, or 
student centered. Figure 28 displays the items in question. 
Teacher responses to- these items were phrased in terms of fre- 
quency of use and u simplify matters have been collapsed into 
tw’o categories — rarely and frequently. 

Practices emphasizing teacher control usually involve the 
teaching of specific skills — a class wdiere the students follow, in 
lock step, the instructions of the teacher. The teacher carefully 
maps out what wall be done according to a highly structured pro- 
gression. In the materials directed set of items, note that for the 
first three items, two-thirds or more of the teachers surveyed said 
they expected students to work frequently on activities that are 
skills oriented and orchestrated in specific ways by either the 
teacher or the materials they have been assigned. Teachers who 
practice in this skill-based manner are presumed to be operating 
consistently within a transmission approach. 

Teaching practices that fit with the notion of shared direC' 
tton expect students to generate ideas, to share w’ith one another, 
and to relate w^hat they are learning to their own experience. 
Teachers still provide a high level of direction and feedback, but 
students are given some latitude as they work wathin a prescribed 
structure. The pattern of responses for the group of items in Figure 
28 designated as tapping shared directicm support this view. 
Teachers who practice this way are associated with the interactive 
approach. 

Teaching practices that center on student autonomy may be 
characterized as centered. Students are encouraged to have 

their cnvn thoughts aK)ut how well they are doing, w'hat they are 
doing, and hcnv they will do it. Within a structured environment 
students are given the i)pport unity to organize themselves and the 
materials they use in order to find meaning in w'hat they read. 
Teachers w'ho Wwov these practices could he called tramactional 
teachers. In Figure 28 responses to the 12 items listed in the group 
headed student centered seem to indicate fairly clearly that teachers 
of 4th grade reading do not often adopt a student-centered 
approach. 



what Teachers Do 



Rarely , Frequently- 



Pircint 



ltaf9rUhUr$€F9/- 

Students ore ntvan ouided proctici with skilk 

Specific skills ore tou$ht of certain times 

Students ore expected to follow the activities outlined in the lesson the taocher has planned 

Students ore invited to conskier how skilk apply to whoi they hove 

Students are toM what they hove learned and hove yet to learn 

Students are directed to onswor o set of the teocher's questions 

Students ore given teocher feedback on how they compore wHh other students 

Sludiiitsiheri.;^ ^ ^ . i ^ ^ 

Sideak .«! V; V; . , .. •. . .. . , • r-; • 

SMiiikWe^ 

Sfwdkwf CisPifiMf XwMKfii!i 

Students ore given the «>pportunity to con^de ^ what they think they have leomed, 
os weU os their perceptions of thsir strengths end weaknesses 

Students ore given the opportunHy to assess their own progress 

Students ore encouraged to compore their written tests with the reading selection 

Students ore encouraged to use the reading selection os a source for ideos when wtiting their tests 

Students ore given the opportunity to provide input (wIh)w they witt be osses^ 

Students ore given the opportunity to work on a variety of different projects 

Studenk establish their own purpose ondgo^ 

Students ore given the opportunity to discuss vorioiis possible thenm for the sek^ . 

Students ore encouroged to compore their written tests with other students' written tests 

El 

Students decide how they will opprooch their tests 
Students hove a choke in who! they will do 

Students me given feedback by the teocher on the themes or mmn ideos oi the selections they reod 

SOURCi U.S. Deportment of Education. National Center for Educalion Statistics. Heod ^g literacy in Ifie United States: fecfinical fteport. Washington 0 1994. 
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Thus, on the basis of teachers' responses to these survey ques' 
tions the following observations seem possible: teachers vary a lot 
with regard to the use of transmission approaches (skills based); 
they frequently use interactive approaches (shared direction); and 
they rarely use transactional (student centered) approaches. 



what Teachers Have Students Do 

Teachers also answered questions about the kind of activities they 
required of their students — and how often. Figure 29 shows the 
21 items in question categorized into three groups: skills'hased 
activities; integrated language arts activities; and, schema-based 
activities. Teachers responded to these items on a five-point fre^ 
quency-of'use scale which has been collapsed, as above, into the 
two categories “rarely" and “frequently". 

Figure 29 shows clearly that teachers frequently ask students to 
work on skills-hased activities, an orientation that corresponds to 
the trammission approach. These activities include working on let- 
ter-sound relationships and word attack skills, learning new vocab- 
ulary from text, and doing reading comprehension exercises. 

Teachers also assign schema-based work that would suggest an 
interactive orientation. They ask students to make predictions dur- 
ing reading, to make inferences and generalizations, summarize 
their reading, relate their experiences to the text, and look for a 
theme or message. 

By contrast, teachers tend not to have students engage in lan- 
guage arts activities that call for the integration of reading, writing, 
speaking, and thinking. These activities require students to be 
much more assertive in relation to what they are learning. Some 
of the activities in this category are ver>* time consuming — putting 
on a play, dramatizing a story — and this may explain why teachers 
do not report using many of the integrative activities on a regular 
basis. 



Are Teachers' Beliefs and Practices Aligned? 

The suggestion here is that teachers' beliefs and practices are not 
especially well aligned. Teachers are oriented away from skills- 
based, transmission approaches, but adopt that approach quite 
often in assigning reading activities to students. They tend to 
accept the transactional arguments of modern reading thet^rists, 
but do not consistently reflect these in their instructional practices. 



what Teachers Hove Students Do 



\ frequently ^ - 



5kitk~B9$$J AitMfks — Trmismhskif 

Uorning Utter-souod rskrtionsiuits 

Work atto(k skills 

Leoming now vocobulory from tisis 

/bswering reading comprehension txofd^ 

Ploying reading gomes (e.g., forming sentences from jumbled words) 

Mokifigprfdktionsc^ v-Vv 

Making generdizo^ and infers v • v * - ‘ • • • v 

Relating experiences to reading / - - . . .^ .. . - . : 

OfoSysonwnaraingthea 

liking for the tiwiiw or ^ ! .\ 

Studying or slntA^ 

intigratiil Umgyage Arts Acttvfths — TransoetkM 

Listening to students reading oioud to small groups or poirs 

Discussion of books read by students 

Dromotizing stories 

Drawing In response to reading 

Diogromming story content 

Writing in response to reading 

Reoding other students' writing 

Student lending discussion about possoge 

Rwiding ploys or dromos 

Comporing pictures and stories 
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SOURCE: U.S. Deportment of Edixotion, Notional Center for Educotion Statistics, f^eoding iiterocy in the United States: h:hnicol Keport Woshington O.C.: 1994. 
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In offering some speculations on why this may be so, we reC' 
ognize that teachers operate within a teaching environment that 
may severely limit their chances of putting into practice what 
they consider to be best practice. First, discussions of reading the^ 
ory have elements of political correctness to them, and reading 
teachers are expected to subscribe to views of teaching whose 
implementation is impractical for reasons of resources and/or 
educational policy. Second, and more specifically, increasing dis' 
cipline problems may push teachers toward drills and workbooks 
as a method of maintaining control in the classroom. Third, 
much of the theorizing about reading has yet to be translated into 
readily usable teaching practice and/or teaching materials. 
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rC/Yierican school systems deal with a very diverse population 
of students and successfully teach them to read. Our students, in 
general, compare favorably with their peers in the other coun^ 
tries participating in the lEA study. American 4th and 9th 
graders do as well as or better than students in 29 other coun^ 
tries participating in the study and are outperformed only by 
students in Finland. Only a small fraction of our student body 
at the 4th and 9th grade level does not meet the average for stu- 
dents in the OECD countries. In fact, a large proportion of our 
most disadvantaged students achieve or exceed this standard. 

While we are doing reasonably well in comparison with 
many of our trading partners, our own national assessment con- 
tinues to paint a different picture. The performance of students 
relative to the achievement standards set by the National 
Assessment Governing Board suggests that American students 
do not reach sufficient levels of reading proficiency. How one 
defines an adequate level of reading proficiency makes a big dif- 
ference in how we see the American educational enterprise. 
This is an issue that should be and is considered in the public 
forums of state houses, state education agencies, local school 
districts, schools, and communities. 

Despite the fact that our students are doing well overall by 
international standards, it is clear that there is an uneven dis- 
tribution of reading proficiency. Some segments of our popula- 
tion do not do as well as others. We need only turn to compar- 
isons of performance among the racial/ethnic grv^ups and vari- 
ous social and economic groups to see that there still are those 
who do well and those who do not. Blacks, the poor, and chil- 
dren of the poorly educated all are at a persistent disadvantage 
with regard to reading proficiency. Our education systems do 
not seem to be ameliorating these differences as well as we 
might hope. 

It is fairly commonplace to show that a variety of family sta- 
tuses are related to student achievement. We do this, and illus- 
trate it here with data on socioeconomic, racial/ethnic, and 
family structure differences in reading comprehension. In a less 
commonplace approach, we look at the same relationships dis- 
entangled from the complex of cimfounding influences w'ithin 
which they are set. In some cases this refinement simply tells us 
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that the influence is not as pronounced as one would have 
thought on the basis of simple observation. In others, it runs 
counter to the observed relationship, at least in part, and 
changes our view of the way in which the world works. 
Racial/ethnic differences are nowhere as pronounced as simple 
observation suggests; a good part of them probably reflects the 
socioeconomic status differences between racial/ethnic groups. 
The poor economic circumstance of families per se is less of an 
impediment to learning than we might think. The apparent dis- 
advantaging effects ascribed to one-parent mother-only families 
are not due to this family configuration as such, but rather to 
the fact that a variety of other disadvantaged statuses are asso- 
ciated with these families. 

In addition to the family, the school and the community 
play a vital role in helping children develop their literacy skills. 
We approach the effects of reading comprehension on students 
as a classroom group using the same strategy and find that, other 
things equal, a school day of more than 5 hours is of benefit rel- 
ative to a shorter school day — basically, more time, more learn- 
ing, more achievement. We find as well some tentative evi- 
dence that smaller classes promote better achievement than 
larger classes. And, we find that where parents get involved 
with schools and support schools in their mission, the reading 
achievement of students benefits. 

How teachers organize instruction has an important influ- 
ence on achievement. This study, as all other cross-sectional 
studies, does not allow us to look at the effect of instruction on 
performance. One year s instruction will not offset the impact of 
all the prior years of instruction. So, with the data at hand, we 
can only describe the state of the art. Teachers profess a strong 
belief in the newer theories that focus more on the student as 
an active reader and learner who must bring knowledge to bear 
on what is being read and taught. Teachers’ instructional strate- 
gies, however, are not as close to the cutting edge. It may be 
that reading instruction is in a state of transition. 

While there is more to be done in the conceptualization 
and design of international studies, especially with respect to 
developing an understanding of why some nations seem better 
able to promote achievement than others, the benefits are fair- 
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ly clear. Any of the participating nations could develop analy^ 
ses like those presented above and, in so doing, place the 
achievement of their students in an international perspective. 
In so doing, we have been able to view the achievement of var^ 
ious subpopulation groups against something like an interna- 
tional benchmark. The view was enlightening since it showed 
our most disadvantaged groups to fare reasonably well relative 
to the average student in OECD nations. 

We found value too in the U.S. national data considered 
apart from that of other nations. It allowed us to provide a per- 
spective on the relationships of student, family, school, and 
community attributes to reading achievement that took into 
account some of the complexity of the various factors at work. 

This potential to inform nations about themselves relative 
to others and about the complexities of educational processes in 
their own nation has clear value as informational input to pol- 
icy decisions designed to promote learning and to promote the 
learning of subpopulation groups presently disadvantaged in this 
respect. 
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